00000001:02000400:3.0F:1782228759.450133:0:2964:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1782228780.043597:0:3184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1782228781.829137:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 549 MB/s 00000001:01000000:3.0:1782228782.079012:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 783 MB/s 00000001:01000000:0.0F:1782228782.328512:0:3247:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3367 MB/s 00000020:02000000:2.0:1782228783.020855:0:3276:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_g7183f09 00000400:02000000:0.0:1782228784.095358:0:3291:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.122@tcp [8/256/0/180] 00008000:02000000:2.0:1782228787.692141:0:3441:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1782228831.977601:0:5246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1782228839.768480:0:5777:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782228839.768490:0:5777:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1782228839.768615:0:5777:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f5e425eb 00000080:02000400:1.0:1782228839.768626:0:5777:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1782228839.772809:0:5777:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1782228839.772826:0:5777:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782228839.772947:0:5777:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a2500812) 00000020:00000080:2.0:1782228839.772968:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782228839.786762:0:5777:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1782228839.787180:0:5777:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782228839.804627:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782228839.804668:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782228839.804689:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782228839.804760:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782228839.804785:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782228839.805152:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782228839.805160:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782228839.805170:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e6340d 00000020:01000004:2.0:1782228839.805177:0:5777:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782228839.805182:0:5777:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782228839.805186:0:5777:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5e425eb from MGS 00000020:01000004:2.0:1782228839.805191:0:5777:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782228839.805201:0:5777:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ce075aae) 00000020:00000080:2.0:1782228839.805211:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782228839.805383:0:5777:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5e425eb from MGS, refs=2 00080000:01000000:2.0:1782228839.805389:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782228839.805403:0:5777:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e6341b 00000100:00100000:2.0:1782228839.805548:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782228839.805664:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782228839.805670:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1782228839.806088:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1782228839.806093:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782228839.806946:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782228839.807102:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782228839.807106:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782228839.807855:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782228839.807863:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782228839.808325:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782228839.808333:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782228839.809034:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228839.809037:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228839.809039:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228839.809604:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228839.809607:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228839.809609:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228839.810112:0:5777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1782228839.812812:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782228840.059507:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4235 MB/s 00000001:01000000:2.0:1782228840.309584:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3679 MB/s 00000001:01000000:3.0:1782228840.560067:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 607 MB/s 00000001:01000000:2.0:1782228840.809964:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 931 MB/s 00080000:10000000:2.0:1782228840.817198:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1782228840.828851:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1782228840.831727:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782228840.831744:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782228840.831747:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782228840.834836:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782228840.834890:0:5777:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782228840.834951:0:5777:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1782228840.835183:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782228840.835210:0:5777:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782228840.835594:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782228840.835833:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782228840.835840:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782228840.836176:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782228840.836181:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782228840.836297:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782228840.836303:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1782228840.836679:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782228840.836701:0:5777:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.122@tcp' 00000020:01000004:2.0:1782228840.836703:0:5777:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782228840.836759:0:5777:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.122@tcp (typ=mgc) 00000020:00000080:2.0:1782228840.836774:0:5777:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.122@tcp (0000000011b6650c) 00000020:00000080:2.0:1782228840.836790:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782228840.836875:0:5777:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000091b72d2c@MGC192.168.204.122@tcp: add connection 192.168.204.122@tcp at head 00010000:00010000:2.0:1782228840.837035:0:5777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.122@tcp-0 is initialized 00000040:01000000:2.0:1782228840.837041:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782228840.837259:0:5793:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1782228840.840127:0:5794:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782228840.840175:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.122@tcp (uuid c9dd69a8-6985-42fa-86d8-1fd8a4966144) 00000020:00000080:0.0:1782228840.840198:0:5777:0:(genops.c:1406:class_connect()) connect: client c9dd69a8-6985-42fa-86d8-1fd8a4966144, cookie 0x8e1c8a3488e63429 00000100:00080000:0.0:1782228840.840209:0:5777:0:(import.c:512:import_select_connection()) MGC192.168.204.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782228840.840215:0:5777:0:(import.c:626:import_select_connection()) MGC192.168.204.122@tcp: import 0000000091b72d2c using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782228840.840261:0:5777:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009019e14a x1868802329411712/t0(0) o250->MGC192.168.204.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782228840.840283:0:5777:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS 00000020:01000004:0.0:1782228840.840303:0:5777:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782228840.840308:0:5777:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782228840.840327:0:5777:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c089ede9) 00000020:00000080:0.0:1782228840.840341:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782228840.841800:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009019e14a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3307:1868802329411712:0@lo:250: 00000100:00100000:3.0:1782228840.841932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228840.842007:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329411712 00000100:00100000:3.0:1782228840.842014:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329411712 00000100:00100000:3.0:1782228840.842055:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782228840.842062:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083839ce0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1868802329411712:12345-0@lo:250: 00010000:00080000:3.0:1782228840.842086:0:5790:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c9dd69a8-6985-42fa-86d8-1fd8a4966144@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:3.0:1782228840.842113:0:5790:0:(genops.c:1406:class_connect()) connect: client c9dd69a8-6985-42fa-86d8-1fd8a4966144, cookie 0x8e1c8a3488e63437 00000100:00080000:3.0:1782228840.842381:0:5790:0:(import.c:65:import_set_state_nolock()) 000000005f7631fe : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782228840.842463:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083839ce0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:3307:x1868802329411712:12345-0@lo:250: Request processed in 400us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228840.842470:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782228840.842517:0:3307:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782228840.842525:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.122@tcp: connect to target with instance 0 00000100:00080000:3.0:1782228840.842532:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782228840.842536:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782228840.842539:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000091b72d2c MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782228840.842542:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782228840.842546:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782228840.842844:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009019e14a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3307:1868802329411712:0@lo:250: 00000100:00100000:0.0:1782228840.861020:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782228840.861898:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782228840.861906:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782228840.864979:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782228840.864992:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782228840.866480:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782228840.866490:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1782228840.867181:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782228840.867372:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1782228840.867382:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782228840.870898:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782228840.870911:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1782228840.907940:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782228840.908145:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1782228840.908152:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1782228840.909597:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1782228840.909608:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782228840.911850:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782228840.912045:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782228840.912052:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782228840.912762:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782228840.912769:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1782228840.913393:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782228840.913756:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782228840.913763:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1782228840.914217:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782228840.914224:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1782228840.915045:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782228840.915198:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782228840.915203:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1782228840.915846:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782228840.915853:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782228840.948948:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782228840.949238:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782228840.949245:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1782228840.951803:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782228840.951826:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782228840.953067:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782228840.953090:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782228840.955216:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782228840.955243:0:5777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1782228840.955249:0:5777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782228840.955390:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782228840.955674:0:5777:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.122@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1782228840.955679:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782228840.955681:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782228840.955682:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228840.955683:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782228840.955685:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228840.955686:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228840.955688:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782228840.955690:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782228840.955691:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782228840.955693:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782228840.955694:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228840.955695:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782228840.955698:0:5777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1782228840.955700:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782228840.955701:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782228840.955703:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228840.955704:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782228840.955705:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228840.955706:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228840.955707:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782228840.955708:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782228840.955709:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782228840.955714:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782228840.955715:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228840.955716:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782228840.955754:0:5777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782228840.955772:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001becf41b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329411840:0@lo:253: 00000100:00100000:3.0:1782228840.955858:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228840.955964:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000561ea873 going to sleep for 11 seconds 00000100:00100000:2.0:1782228840.956040:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329411840 00000100:00100000:2.0:1782228840.956048:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329411840 00000100:00100000:2.0:1782228840.956133:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782228840.956152:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000132b7f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:5777:x1868802329411840:12345-0@lo:253: 20000000:01000000:2.0:1782228840.956198:0:5792:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782228840.956200:0:5792:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1782228840.956821:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782228840.956876:0:5792:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1782228840.957216:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782228840.958333:0:5813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1782228840.958751:0:5792:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782228840.958755:0:5792:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1782228840.958761:0:5792:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1782228840.958765:0:5792:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1782228840.958780:0:5792:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1782228840.958977:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228840.959312:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1782228840.959326:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782228840.959377:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1782228840.963905:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1782228840.963998:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1782228840.964141:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1782228840.964151:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1782228840.964198:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1782228840.964206:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1782228840.964238:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1782228840.964244:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1782228840.964305:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1782228840.964364:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1782228840.964397:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782228840.964403:0:5792:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1782228840.964509:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228840.964739:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1782228840.964750:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782228840.964784:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1782228840.964814:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1782228840.964860:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1782228840.964872:0:5792:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1782228840.964946:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1782228840.964954:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782228840.964996:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1782228840.965031:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1782228840.965063:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1782228840.965073:0:5792:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1782228840.965166:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1782228840.965176:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1782228840.965207:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1782228840.965243:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1782228840.965400:0:5792:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1782228840.965700:0:5792:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1782228840.965707:0:5792:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1782228840.966206:0:5814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1782228840.966734:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1782228840.966763:0:5792:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.122@tcp for mdt 20000000:01000000:2.0:1782228840.966765:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.122@tcp (null) (null) (null) 00000040:00080000:2.0:1782228840.966803:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1782228840.966811:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782228840.966840:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1782228840.966846:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.122@tcp (null) (null) 00000040:00080000:2.0:1782228840.966908:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1782228840.966918:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1782228840.966959:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1782228840.966993:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1782228840.967051:0:5792:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782228840.967055:0:5792:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782228840.967058:0:5792:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782228840.967069:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782228840.967071:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782228840.967098:0:5792:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782228840.967100:0:5792:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782228840.967621:0:5815:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1782228840.967925:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1782228840.967966:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1782228840.967997:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1782228840.968006:0:5792:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782228840.968007:0:5792:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782228840.968339:0:5816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1782228840.968675:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1782228840.968714:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1782228840.968798:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1782228840.968812:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782228840.968814:0:5792:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1782228840.968818:0:5792:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782228840.968820:0:5792:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782228840.968825:0:5792:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1782228840.968831:0:5792:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1782228840.969148:0:5817:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1782228840.969274:0:5792:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1782228840.988504:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1782228840.988569:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1782228840.988645:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1782228840.988681:0:5792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782228840.988703:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988721:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988731:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988737:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988743:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988749:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988755:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000ee5a68c already unused, calling callback (000000008fcd2c75) 00010000:00010000:3.0:1782228840.988759:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988785:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988798:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988804:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228840.988810:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ee5a68c/0x8e1c8a3488e6343e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782228840.988827:0:5792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782228841.206989:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000132b7f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:5777:x1868802329411840:12345-0@lo:253: Request processed in 250830us (251122us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228841.207009:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782228841.207121:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001becf41b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329411840:0@lo:253: 10000000:01000000:3.0:1782228841.207137:0:5777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782228841.207140:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782228841.207141:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782228841.207143:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228841.207143:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1782228841.207145:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228841.207146:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228841.207147:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782228841.207148:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782228841.207150:0:5777:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782228841.207151:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228841.207152:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782228841.207171:0:5777:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5e425eb from lustre-MDT0000 10000000:01000000:3.0:1782228841.207192:0:5777:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782228841.207195:0:5777:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782228841.207200:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98fe68ea3380 10000000:01000000:3.0:1782228841.207204:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782228841.207212:0:5777:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff98fe68ea3380 from 1 10000000:01000000:3.0:1782228841.207220:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782228841.207300:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 000000000ee5a68c/0x8e1c8a3488e63445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.207311:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 000000000ee5a68c/0x8e1c8a3488e63445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.207320:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 000000000ee5a68c/0x8e1c8a3488e63445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228841.207338:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001becf41b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329411968:0@lo:101: 00000100:00100000:3.0:1782228841.207373:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228841.207521:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 000000004a539634 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.207531:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329411968 00000100:00100000:2.0:1782228841.207537:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329411968 00000100:00100000:2.0:1782228841.207578:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782228841.207587:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ccc5a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:5777:x1868802329411968:12345-0@lo:101: 00010000:00010000:2.0:1782228841.207599:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228841.207617:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eedae8da/0x8e1c8a3488e6344c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63445 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.207654:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eedae8da/0x8e1c8a3488e6344c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.207663:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eedae8da/0x8e1c8a3488e6344c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.207672:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eedae8da, rc 0) 00000100:00100000:2.0:1782228841.207714:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ccc5a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+6:5777:x1868802329411968:12345-0@lo:101: Request processed in 128us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.207721:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782228841.207759:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001becf41b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329411968:0@lo:101: 00010000:00010000:0.0:1782228841.207772:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 000000000ee5a68c/0x8e1c8a3488e63445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.207779:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 000000000ee5a68c/0x8e1c8a3488e63445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228841.207824:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412096:0@lo:501: 00000100:00100000:0.0:1782228841.207865:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.207890:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000519580f0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228841.207938:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412096 00000100:00100000:3.0:1782228841.207942:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412096 00000100:00100000:3.0:1782228841.207974:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782228841.207980:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000273bae47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+6:5777:x1868802329412096:12345-0@lo:501: 00000100:00100000:3.0:1782228841.208281:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000273bae47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+6:5777:x1868802329412096:12345-0@lo:501: Request processed in 302us (416us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782228841.208289:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782228841.208340:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412096:0@lo:501: 10000000:01000000:0.0:1782228841.208362:0:5777:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782228841.208505:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: 000000000ee5a68c/0x8e1c8a3488e63445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.208521:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: 000000000ee5a68c/0x8e1c8a3488e63445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228841.208530:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fe50300000 10000000:01000000:0.0:1782228841.208534:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782228841.208538:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98fe50300000 10000000:01000000:0.0:1782228841.208540:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782228841.208543:0:5777:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff98fe50300000 from 1 10000000:01000000:0.0:1782228841.208545:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782228841.208563:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 000000005864ec5b/0x8e1c8a3488e63453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.208578:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 000000005864ec5b/0x8e1c8a3488e63453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.208585:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 000000005864ec5b/0x8e1c8a3488e63453 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228841.208598:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412224:0@lo:101: 00000100:00100000:0.0:1782228841.208634:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.208696:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000519580f0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.208869:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412224 00000100:00100000:2.0:1782228841.208874:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412224 00000100:00100000:2.0:1782228841.208941:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782228841.208948:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d98e2794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+6:5777:x1868802329412224:12345-0@lo:101: 00010000:00010000:2.0:1782228841.208957:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228841.208967:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c8dfef8/0x8e1c8a3488e6345a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63453 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.208986:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c8dfef8/0x8e1c8a3488e6345a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63453 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.208995:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c8dfef8/0x8e1c8a3488e6345a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63453 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.209001:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c8dfef8, rc 0) 00000100:00100000:2.0:1782228841.209036:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d98e2794 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+7:5777:x1868802329412224:12345-0@lo:101: Request processed in 90us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.209057:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782228841.209121:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412224:0@lo:101: 00010000:00010000:0.0:1782228841.209131:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 000000005864ec5b/0x8e1c8a3488e63453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.209138:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 000000005864ec5b/0x8e1c8a3488e63453 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228841.209162:0:5777:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782228841.209180:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: 000000005864ec5b/0x8e1c8a3488e63453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.209187:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: 000000005864ec5b/0x8e1c8a3488e63453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228841.209194:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782228841.209197:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782228841.209202:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98fe50300000 10000000:01000000:0.0:1782228841.209204:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782228841.209207:0:5777:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782228841.209209:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782228841.209222:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 00000000f51b5ad7/0x8e1c8a3488e63461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.209228:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 00000000f51b5ad7/0x8e1c8a3488e63461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.209235:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 00000000f51b5ad7/0x8e1c8a3488e63461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228841.209246:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412352:0@lo:101: 00000100:00100000:0.0:1782228841.209271:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.209536:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000519580f0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228841.209744:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412352 00000100:00100000:3.0:1782228841.209749:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412352 00000100:00100000:3.0:1782228841.209773:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782228841.209778:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daaf5094 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+7:5777:x1868802329412352:12345-0@lo:101: 00010000:00010000:3.0:1782228841.209786:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228841.209796:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005cfdf76b/0x8e1c8a3488e63468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63461 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.209812:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005cfdf76b/0x8e1c8a3488e63468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.209827:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005cfdf76b/0x8e1c8a3488e63468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.209834:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005cfdf76b, rc 0) 00000100:00100000:3.0:1782228841.209872:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000daaf5094 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+8:5777:x1868802329412352:12345-0@lo:101: Request processed in 94us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228841.209878:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782228841.209953:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412352:0@lo:101: 00010000:00010000:0.0:1782228841.209963:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 00000000f51b5ad7/0x8e1c8a3488e63461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.209978:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 00000000f51b5ad7/0x8e1c8a3488e63461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228841.210022:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412480:0@lo:501: 00000100:00100000:0.0:1782228841.210048:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.210067:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000519580f0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228841.210117:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412480 00000100:00100000:3.0:1782228841.210121:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412480 00000100:00100000:3.0:1782228841.210138:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782228841.210142:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000571f923 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+8:5777:x1868802329412480:12345-0@lo:501: 00000100:00100000:3.0:1782228841.210388:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000571f923 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5777:x1868802329412480:12345-0@lo:501: Request processed in 245us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228841.210395:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782228841.210510:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412480:0@lo:501: 00000100:00100000:0.0:1782228841.210537:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412608:0@lo:503: 00000100:00100000:0.0:1782228841.210588:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.210727:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000519580f0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228841.210805:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412608 00000100:00100000:3.0:1782228841.210810:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412608 00000100:00100000:3.0:1782228841.210826:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782228841.210831:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3fd6a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5777:x1868802329412608:12345-0@lo:503: 00000100:00100000:3.0:1782228841.210978:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3fd6a02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5777:x1868802329412608:12345-0@lo:503: Request processed in 146us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228841.210984:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782228841.211064:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412608:0@lo:503: 00000100:00100000:3.0:1782228841.211798:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001e2c49a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5819:1868802329412736:0@lo:502: 00000100:00100000:3.0:1782228841.211846:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228841.211880:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set 00000000880d0195 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.211936:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412736 00000100:00100000:2.0:1782228841.211942:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412736 00000100:00100000:2.0:1782228841.212004:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782228841.212010:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5bcefee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5819:x1868802329412736:12345-0@lo:502: 00000100:00100000:2.0:1782228841.212221:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5bcefee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5819:x1868802329412736:12345-0@lo:502: Request processed in 211us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.212228:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782228841.212313:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001e2c49a6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5819:1868802329412736:0@lo:502: 00000020:01000000:0.0:1782228841.212339:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782228841.212351:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228841.212354:0:5819:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782228841.212359:0:5819:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782228841.212362:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782228841.212375:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000027bbeab2) 00000020:00000080:0.0:1782228841.212393:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782228841.212399:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782228841.212581:0:5819:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782228841.212589:0:5819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e63476 00000020:00000080:0.0:1782228841.212953:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782228841.212958:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782228841.212961:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228841.212963:0:5819:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782228841.212971:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782228841.212975:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228841.212976:0:5819:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782228841.212980:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782228841.212987:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d8f2700d) 00000020:00000080:0.0:1782228841.212997:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782228841.213000:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782228841.213002:0:5819:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782228841.213005:0:5819:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782228841.213011:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782228841.213048:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5e425eb from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782228841.213060:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a2c12964) 00000020:00000080:0.0:1782228841.213067:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782228841.213127:0:5819:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782228841.213133:0:5819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e6348b 00000020:00000080:0.0:1782228841.213210:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782228841.213217:0:5819:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782228841.213221:0:5819:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8e1c8a3488e63492 00080000:01000000:0.0:1782228841.213224:0:5819:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782228841.213227:0:5819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e63499 00080000:10000000:0.0:1782228841.214005:0:5819:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1782228841.214194:0:5819:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1782228841.220133:0:5819:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1782228841.284871:0:5819:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1782228841.285220:0:5819:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1782228841.289114:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1782228841.289675:0:5819:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782228841.329004:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d13c5de3) 00000020:00000080:3.0:1782228841.329026:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782228841.329225:0:5819:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782228841.329232:0:5819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e634a7 00000020:00000080:1.0:1782228841.339984:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1782228841.343656:0:5819:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1782228841.384683:0:5819:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1782228841.413162:0:5819:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.457416:0:5819:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.491925:0:5819:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.539153:0:5819:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1782228841.568122:0:5819:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8e1c8a3488e634ae 00000020:00000080:1.0:1782228841.568584:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782228841.568603:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782228841.568609:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228841.568611:0:5819:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782228841.568615:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782228841.568619:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228841.568620:0:5819:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782228841.568623:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782228841.568625:0:5819:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782228841.568627:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782228841.568629:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228841.568630:0:5819:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782228841.568632:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782228841.568636:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228841.568637:0:5819:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782228841.568642:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782228841.568677:0:5819:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1782228841.568742:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5819:1868802329412864:0@lo:502: 00000100:00100000:1.0:1782228841.568850:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.568926:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set 00000000657886b0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.569204:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412864 00000100:00100000:2.0:1782228841.569213:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412864 00000100:00100000:2.0:1782228841.569278:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782228841.569287:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082223d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5819:x1868802329412864:12345-0@lo:502: 00000100:00100000:2.0:1782228841.569877:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082223d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5819:x1868802329412864:12345-0@lo:502: Request processed in 590us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.569886:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782228841.569998:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5819:1868802329412864:0@lo:502: 00000020:01000000:1.0:1782228841.570040:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782228841.570047:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228841.570049:0:5819:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1782228841.570053:0:5819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1782228841.570303:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1782228841.570324:0:5777:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782228841.570343:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: 00000000f51b5ad7/0x8e1c8a3488e63461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.570356:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: 00000000f51b5ad7/0x8e1c8a3488e63461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228841.570371:0:5777:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fe50300000 from 1 10000000:01000000:0.0:1782228841.570374:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782228841.570417:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.570424:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.570471:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228841.570489:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412992:0@lo:101: 00000100:00100000:0.0:1782228841.570530:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.570554:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 0000000012412775 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.570621:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329412992 00000100:00100000:2.0:1782228841.570627:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329412992 00000100:00100000:2.0:1782228841.570815:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782228841.570823:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe4f71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:5777:x1868802329412992:12345-0@lo:101: 00010000:00010000:2.0:1782228841.570836:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228841.570849:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e634b5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.570874:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.570895:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.570904:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040c32bc7, rc 0) 00000100:00100000:2.0:1782228841.570947:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe4f71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:5777:x1868802329412992:12345-0@lo:101: Request processed in 125us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.570954:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782228841.571024:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000000344ff6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329412992:0@lo:101: 00010000:00010000:1.0:1782228841.571036:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.571044:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228841.571645:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413120:0@lo:256: 00000100:00100000:1.0:1782228841.571684:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.572125:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000657886b0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228841.572198:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329413120 00000100:00100000:0.0:1782228841.572204:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329413120 00000100:00100000:0.0:1782228841.572231:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782228841.572236:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a39158a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:5777:x1868802329413120:12345-0@lo:256: 20000000:01000000:0.0:1782228841.572252:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782228841.572257:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782228841.572334:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a39158a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:5777:x1868802329413120:12345-0@lo:256: Request processed in 97us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228841.572341:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782228841.572425:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413120:0@lo:256: 10000000:01000000:1.0:1782228841.573171:0:5777:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782228841.573185:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.573195:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228841.573202:0:5777:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe50300000 from 1 10000000:01000000:1.0:1782228841.573205:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782228841.573234:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.573241:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.573258:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228841.573274:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413248:0@lo:101: 00000100:00100000:1.0:1782228841.573318:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.573343:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000657886b0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228841.573464:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329413248 00000100:00100000:0.0:1782228841.573471:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329413248 00000100:00100000:0.0:1782228841.573497:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782228841.573502:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041acd40d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:5777:x1868802329413248:12345-0@lo:101: 00010000:00010000:0.0:1782228841.573512:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228841.573531:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e634c3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.573552:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.573561:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.573567:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c02761f, rc 0) 00000100:00100000:0.0:1782228841.573614:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041acd40d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:5777:x1868802329413248:12345-0@lo:101: Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228841.573620:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782228841.573771:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413248:0@lo:101: 00010000:00010000:1.0:1782228841.573784:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.573792:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228841.573840:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413376:0@lo:501: 00000100:00100000:1.0:1782228841.573868:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.573882:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000657886b0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228841.573931:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329413376 00000100:00100000:0.0:1782228841.573935:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329413376 00000100:00100000:0.0:1782228841.573952:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782228841.573957:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016fb7b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:5777:x1868802329413376:12345-0@lo:501: 00000100:00100000:0.0:1782228841.574590:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016fb7b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:5777:x1868802329413376:12345-0@lo:501: Request processed in 631us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228841.574775:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413376:0@lo:501: 00000100:00100000:1.0:1782228841.574810:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413504:0@lo:503: 00000100:00100000:1.0:1782228841.574849:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.574869:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000657886b0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.574931:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329413504 00000100:00100000:2.0:1782228841.574936:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329413504 00000100:00100000:2.0:1782228841.574958:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782228841.574964:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bff60add pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329413504:12345-0@lo:503: 00000040:00080000:2.0:1782228841.575074:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782228841.575122:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bff60add pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329413504:12345-0@lo:503: Request processed in 158us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.575129:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782228841.575202:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413504:0@lo:503: 00000100:00100000:0.0:1782228841.576511:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000040:00080000:3.0:1782228841.577064:0:5823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1782228841.577295:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1782228841.577316:0:5777:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782228841.577335:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.577367:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228841.577427:0:5777:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782228841.577451:0:5777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fe50300000 10000000:01000000:1.0:1782228841.577455:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fe50300000 10000000:01000000:1.0:1782228841.577459:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782228841.577465:0:5777:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe50300000 from 1 10000000:01000000:1.0:1782228841.577467:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782228841.577500:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 00000000fc35bb7e/0x8e1c8a3488e634d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.577507:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 00000000fc35bb7e/0x8e1c8a3488e634d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.577516:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 00000000fc35bb7e/0x8e1c8a3488e634d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228841.577535:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413632:0@lo:101: 00000100:00100000:1.0:1782228841.577589:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.577811:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f84a2d14 going to sleep for 11 seconds 00000100:00100000:3.0:1782228841.577943:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329413632 00000100:00100000:3.0:1782228841.577952:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329413632 00000100:00100000:3.0:1782228841.578039:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782228841.578051:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038bd429b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:5777:x1868802329413632:12345-0@lo:101: 00010000:00010000:3.0:1782228841.578066:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228841.578081:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bcb8ac8/0x8e1c8a3488e634d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e634d1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.578106:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bcb8ac8/0x8e1c8a3488e634d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.578116:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bcb8ac8/0x8e1c8a3488e634d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.578124:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bcb8ac8, rc 0) 00000100:00100000:3.0:1782228841.578179:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038bd429b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329413632:12345-0@lo:101: Request processed in 131us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228841.578187:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782228841.578249:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413632:0@lo:101: 00010000:00010000:1.0:1782228841.578263:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 00000000fc35bb7e/0x8e1c8a3488e634d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.578271:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 00000000fc35bb7e/0x8e1c8a3488e634d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228841.578334:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413760:0@lo:501: 00000100:00100000:1.0:1782228841.578361:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.578477:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f84a2d14 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.578696:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329413760 00000100:00100000:2.0:1782228841.578701:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329413760 00000100:00100000:2.0:1782228841.578722:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782228841.578728:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092de2baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329413760:12345-0@lo:501: 00000100:00100000:2.0:1782228841.579003:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092de2baf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329413760:12345-0@lo:501: Request processed in 275us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.579010:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782228841.579140:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413760:0@lo:501: 00000100:00100000:1.0:1782228841.579176:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413888:0@lo:503: 00000100:00100000:1.0:1782228841.579219:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228841.579243:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f84a2d14 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.579293:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329413888 00000100:00100000:2.0:1782228841.579298:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329413888 00000100:00100000:2.0:1782228841.579332:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782228841.579337:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080347f17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329413888:12345-0@lo:503: 00000100:00100000:2.0:1782228841.579989:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080347f17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329413888:12345-0@lo:503: Request processed in 649us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.579997:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782228841.580114:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329413888:0@lo:503: 00000100:00100000:3.0:1782228841.580709:0:5824:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000dc8905f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5824:1868802329414016:0@lo:502: 00000100:00100000:3.0:1782228841.580752:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228841.580822:0:5824:0:(client.c:2701:ptlrpc_set_wait()) set 000000008b5d2382 going to sleep for 11 seconds 00000100:00100000:2.0:1782228841.580852:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414016 00000100:00100000:2.0:1782228841.580857:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414016 00000100:00100000:2.0:1782228841.580921:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782228841.580928:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a43721de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5824:x1868802329414016:12345-0@lo:502: 00000100:00100000:2.0:1782228841.581155:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a43721de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5824:x1868802329414016:12345-0@lo:502: Request processed in 227us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228841.581162:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782228841.581230:0:5824:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000dc8905f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5824:1868802329414016:0@lo:502: 00000020:01000004:0.0:1782228841.581285:0:5824:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1782228841.581307:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000f57b0d3) 00000020:00000080:0.0:1782228841.581325:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1782228841.581546:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5e425eb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782228841.581551:0:5824:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f5e425eb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782228841.581553:0:5824:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000f5e425eb 4 00010000:00080000:0.0:1782228841.581582:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f88669af@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.122@tcp at head 00010000:00010000:0.0:1782228841.583205:0:5824:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1782228841.583306:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782228841.583340:0:5824:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782228841.583352:0:5824:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8e1c8a3488e634e6 00000100:00080000:0.0:1782228841.583361:0:5824:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782228841.583365:0:5824:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f88669af using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782228841.583411:0:5824:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cc986472 x1868802329414144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782228841.583459:0:5824:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782228841.583489:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cc986472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329414144:0@lo:38: 00000100:00100000:3.0:1782228841.583612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.585498:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414144 00000100:00100000:0.0:1782228841.585510:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414144 00000100:00100000:0.0:1782228841.585555:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782228841.585562:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db37800e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1868802329414144:12345-0@lo:38: 00000100:00100000:0.0:1782228841.585878:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db37800e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1868802329414144:12345-0@lo:38: Request processed in 314us (2266us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782228841.585886:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782228841.585935:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782228841.585942:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000f88669af lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782228841.585947:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782228841.585950:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cc986472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329414144:0@lo:38: 00000100:00100000:0.0:1782228841.588749:0:5824:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cc986472 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5824:1868802329414272:0@lo:502: 00000100:00100000:0.0:1782228841.588833:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228841.588872:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414272 00000100:00100000:0.0:1782228841.588878:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414272 00000100:00100000:0.0:1782228841.588927:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782228841.588935:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a836ff5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5824:x1868802329414272:12345-0@lo:502: 00000100:00100000:0.0:1782228841.589166:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a836ff5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5824:x1868802329414272:12345-0@lo:502: Request processed in 231us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228841.589185:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782228841.589234:0:5824:0:(client.c:2701:ptlrpc_set_wait()) set 0000000039e641e4 going to sleep for 11 seconds 00000100:00100000:0.0:1782228841.589254:0:5824:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cc986472 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5824:1868802329414272:0@lo:502: 00000040:00080000:0.0:1782228841.589279:0:5824:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1782228841.589361:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1782228841.589384:0:5777:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782228841.589410:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: 00000000fc35bb7e/0x8e1c8a3488e634d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228841.589420:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: 00000000fc35bb7e/0x8e1c8a3488e634d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782228841.589516:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782228841.589519:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782228841.589520:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228841.589521:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782228841.589522:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228841.589523:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228841.589524:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782228841.589526:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782228841.589527:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782228841.589528:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782228841.589529:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228841.589531:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782228841.589534:0:5777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1782228841.589536:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782228841.589537:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782228841.589538:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228841.589539:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782228841.589540:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228841.589541:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228841.589542:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782228841.589543:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782228841.589544:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782228841.589545:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782228841.589546:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228841.589547:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782228841.589561:0:5777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782228841.589570:0:5777:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b9c5cf22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329414400:0@lo:253: 00000100:00100000:3.0:1782228841.589616:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228841.589659:0:5777:0:(client.c:2701:ptlrpc_set_wait()) set 00000000301d9954 going to sleep for 11 seconds 00000100:00100000:0.0:1782228841.589696:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414400 00000100:00100000:0.0:1782228841.589801:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414400 00000100:00100000:0.0:1782228841.589841:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782228841.589849:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032450833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5777:x1868802329414400:12345-0@lo:253: 20000000:01000000:0.0:1782228841.589871:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782228841.589885:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782228841.624289:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782228841.624309:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1782228841.624406:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782228841.624411:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782228841.624456:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.624475:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.624483:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.624553:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.624568:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 12 pid: 5790 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228841.624582:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000705e0ee5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1868802329414528:0@lo:104: 00000100:00100000:2.0:1782228841.624656:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228841.624708:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c4288fcf going to sleep for 11 seconds 00000100:00100000:1.0:1782228841.624769:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414528 00000100:00100000:1.0:1782228841.624778:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414528 00000100:00100000:1.0:1782228841.624823:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782228841.624831:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000634e3722 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5812:x1868802329414528:12345-0@lo:104: 00010000:00010000:1.0:1782228841.624843:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228841.624893:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782228841.624898:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000634e3722 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5812:x1868802329414528:12345-0@lo:104: Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228841.624905:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1782228841.624987:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228841.624993:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625000:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f2f0bc25 already unused, calling callback (00000000b72478df) 10000000:00010000:0.0:1782228841.625003:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625010:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228841.625015:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228841.625020:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228841.625055:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625062:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228841.625082:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625088:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: 00000000f2f0bc25/0x8e1c8a3488e634b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634bc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625105:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228841.625106:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228841.625108:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228841.625340:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cc986472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329414656:0@lo:103: 00000100:00100000:2.0:1782228841.625370:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228841.625491:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000705e0ee5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1868802329414528:0@lo:104: 00010000:00010000:2.0:1782228841.625508:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228841.625676:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414656 00000100:00100000:0.0:1782228841.625681:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414656 00010000:00010000:0.0:1782228841.625698:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 13 pid: 5790 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228841.625729:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782228841.625734:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003fa27d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:3309:x1868802329414656:12345-0@lo:103: 00010000:00010000:0.0:1782228841.625745:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228841.625749:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 13 pid: 5790 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625760:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 13 pid: 5790 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625771:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040c32bc7/0x8e1c8a3488e634bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e634b5 expref: 13 pid: 5790 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625782:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625789:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782228841.625813:0:5781:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001402986s 00010000:00010000:0.0:1782228841.625816:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625822:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625827:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625833:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625838:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000007b0cfba already unused, calling callback (000000008fcd2c75) 00010000:00010000:0.0:1782228841.625841:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625847:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625858:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228841.625867:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228841.625898:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003fa27d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:3309:x1868802329414656:12345-0@lo:103: Request processed in 164us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228841.625905:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782228841.626008:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cc986472 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329414656:0@lo:103: 00010000:00010000:2.0:1782228841.626026:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.626032:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228841.626037:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000007b0cfba/0x8e1c8a3488e634ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228841.633147:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032450833 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:5777:x1868802329414400:12345-0@lo:253: Request processed in 43291us (43522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228841.633163:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782228841.633247:0:5777:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b9c5cf22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5777:1868802329414400:0@lo:253: 10000000:01000000:3.0:1782228841.633263:0:5777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782228841.633266:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782228841.633268:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782228841.633269:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228841.633270:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782228841.633272:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228841.633273:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228841.633274:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782228841.633275:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782228841.633277:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782228841.633278:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782228841.633280:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228841.633281:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782228841.633296:0:5777:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782228841.639882:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.640277:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1782228841.640677:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.640870:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1782228841.641096:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.641287:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1782228841.642117:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.642309:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1782228841.642691:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.642889:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1782228841.643130:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1782228841.643323:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1782228841.691244:0:5777:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1782228841.730503:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1782228841.730614:0:5829:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1782228841.730619:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1782228841.730934:0:5830:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782228841.735026:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1782228841.741270:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782228841.741926:0:5777:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782228841.742105:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1782228841.743375:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782228841.745566:0:5777:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1782228841.746614:0:5777:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782228841.746651:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1782228841.746895:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782228841.749666:0:5777:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1782228841.751603:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1782228841.751747:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1782228841.752422:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1782228841.752610:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1782228841.752776:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1782228841.752925:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1782228841.753217:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1782228841.753516:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1782228841.753683:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782228841.753821:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782228841.754047:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782228841.754259:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782228841.754575:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782228841.754712:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782228841.754864:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782228841.755165:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782228841.755823:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782228841.755956:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782228841.756239:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782228841.756509:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782228841.756659:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782228841.756805:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782228841.756948:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782228841.757253:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782228841.757636:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782228841.757781:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782228841.757926:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782228841.758325:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782228841.758630:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782228841.758775:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782228841.758929:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782228841.759228:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782228841.759537:0:5777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1782228841.770280:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1782228841.819692:0:5777:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1782228841.819735:0:5777:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb64481cc7988 00100000:10000000:2.0:1782228841.819744:0:5777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1782228841.821007:0:5777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782228841.821023:0:5777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782228841.821038:0:5777:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1782228841.821055:0:5777:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1782228841.851734:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782228841.860896:0:5830:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782228841.861485:0:5830:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782228841.861491:0:5830:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1782228842.875968:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228843.900178:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228844.924782:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782228845.740643:0:6072:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782228845.955506:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782228846.716741:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782228846.716751:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fe50300000 from 3 10000000:01000000:1.0:1782228846.716757:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782228846.716801:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 0000000031820d1f/0x8e1c8a3488e634f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228846.716813:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 0000000031820d1f/0x8e1c8a3488e634f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228846.716824:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 0000000031820d1f/0x8e1c8a3488e634f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228846.716845:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329414784:0@lo:101: 00000100:00100000:1.0:1782228846.716917:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228846.716975:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a94222e9 going to sleep for 11 seconds 00000100:00100000:3.0:1782228846.717069:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414784 00000100:00100000:3.0:1782228846.717077:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414784 00000100:00100000:3.0:1782228846.717133:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782228846.717141:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066ff5d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:5794:x1868802329414784:12345-0@lo:101: 00010000:00010000:3.0:1782228846.717158:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228846.717174:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e9bb814/0x8e1c8a3488e634fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e634f4 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228846.717198:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e9bb814/0x8e1c8a3488e634fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228846.717208:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e9bb814/0x8e1c8a3488e634fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228846.717218:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e9bb814, rc 0) 00000100:00100000:3.0:1782228846.717256:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066ff5d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329414784:12345-0@lo:101: Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228846.717263:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782228846.717317:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000451f6613 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329414784:0@lo:101: 00010000:00010000:3.0:1782228846.717331:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 0000000031820d1f/0x8e1c8a3488e634f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228846.717347:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 0000000031820d1f/0x8e1c8a3488e634f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228846.717392:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b9c5cf22 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329414912:0@lo:256: 00000100:00100000:3.0:1782228846.717422:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228846.717478:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set 000000000f715cfd going to sleep for 11 seconds 00000100:00100000:1.0:1782228846.717558:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329414912 00000100:00100000:1.0:1782228846.717562:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329414912 00000100:00100000:1.0:1782228846.717598:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782228846.717603:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fbcefd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329414912:12345-0@lo:256: 20000000:01000000:1.0:1782228846.717617:0:5792:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782228846.717631:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782228846.717634:0:5792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1782228846.717705:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fbcefd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329414912:12345-0@lo:256: Request processed in 102us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228846.717712:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782228846.717877:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b9c5cf22 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329414912:0@lo:256: 10000000:01000000:3.0:1782228846.717916:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782228846.717923:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: 0000000031820d1f/0x8e1c8a3488e634f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228846.717930:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: 0000000031820d1f/0x8e1c8a3488e634f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782228846.719400:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782228846.719409:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782228846.719412:0:36:0:(import.c:65:import_set_state_nolock()) 00000000f88669af lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782228846.719423:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f88669af using connection 192.168.204.122@tcp/0@lo 00000100:00100000:2.0:1782228846.719477:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000705e0ee5 x1868802329415040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782228846.719568:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000705e0ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329415040:0@lo:38: 00000100:00100000:3.0:1782228846.719635:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228846.719735:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415040 00000100:00100000:1.0:1782228846.719742:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415040 00000100:00100000:1.0:1782228846.719774:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782228846.719787:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9c5cf22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1868802329415040:12345-0@lo:38: 00010000:00080000:1.0:1782228846.719812:0:5798:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1782228846.719846:0:5798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8e1c8a3488e63502 00000004:00100000:1.0:1782228846.719889:0:5798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782228846.720003:0:5798:0:(import.c:65:import_set_state_nolock()) 00000000bb8cefe1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782228846.729725:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9c5cf22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868802329415040:12345-0@lo:38: Request processed in 9928us (10080us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228846.729743:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782228846.729923:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000705e0ee5 x1868802329415040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782228856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782228846.729940:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782228846.729949:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782228846.729954:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782228846.729957:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000f88669af lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782228846.729965:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000705e0ee5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329415040:0@lo:38: 00010000:00010000:3.0:1782228846.975591:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228847.995912:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228849.020759:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228850.044400:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782228850.243252:0:6275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8fb37b80 20000000:00000080:2.0:1782228850.243269:0:6275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fe5096d400 uarg=0000000000000000 20000000:01000000:2.0:1782228850.243522:0:6275:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1782228850.243529:0:6275:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1782228850.243533:0:6275:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1782228850.243904:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1782228850.243915:0:6275:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1782228850.250806:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228850.251073:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782228850.251128:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1782228850.251178:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1782228850.251194:0:6275:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782228850.251311:0:6275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228850.251332:0:6275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228850.251341:0:6275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228850.251392:0:6275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228850.251404:0:6275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 11 pid: 5791 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228850.251414:0:6275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003237384c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1868802329415168:0@lo:104: 00000100:00100000:2.0:1782228850.251591:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228850.251696:0:6275:0:(client.c:2701:ptlrpc_set_wait()) set 000000002ef8a2d8 going to sleep for 11 seconds 00000100:00100000:0.0:1782228850.251745:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415168 00000100:00100000:0.0:1782228850.251752:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415168 00000100:00100000:0.0:1782228850.251827:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782228850.251835:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa17d9c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:6275:x1868802329415168:12345-0@lo:104: 00010000:00010000:0.0:1782228850.251847:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228850.251951:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782228850.251957:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa17d9c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:6275:x1868802329415168:12345-0@lo:104: Request processed in 123us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228850.251971:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782228850.252018:0:6275:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003237384c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1868802329415168:0@lo:104: 00010000:00010000:3.0:1782228850.252038:0:6275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228850.252098:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782228850.252103:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228850.252111:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db0d4af2 already unused, calling callback (00000000b72478df) 10000000:00010000:1.0:1782228850.252114:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228850.252121:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782228850.252128:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228850.252133:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782228850.252165:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228850.252172:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782228850.252472:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000eac3063f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329415296:0@lo:103: 00000100:00100000:2.0:1782228850.252508:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228850.252556:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415296 00000100:00100000:3.0:1782228850.252561:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415296 00010000:00010000:1.0:1782228850.252584:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.252587:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 12 pid: 5791 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228850.252611:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: 00000000db0d4af2/0x8e1c8a3488e634c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634ca expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228850.252620:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782228850.252629:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5e06660 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:3310:x1868802329415296:12345-0@lo:103: 00010000:00010000:1.0:1782228850.252632:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228850.252635:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228850.252637:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228850.252640:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228850.252645:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 12 pid: 5791 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.252655:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 12 pid: 5791 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.252667:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c02761f/0x8e1c8a3488e634ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e634c3 expref: 12 pid: 5791 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.252679:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.252687:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.252699:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.252705:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.253307:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.253314:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.253319:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003779800 already unused, calling callback (000000008fcd2c75) 00010000:00010000:3.0:1782228850.253322:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.253329:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.253352:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228850.253364:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228850.253408:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5e06660 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:3310:x1868802329415296:12345-0@lo:103: Request processed in 780us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228850.253416:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782228850.253661:0:6275:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228850.253670:0:6275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228850.253674:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000eac3063f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329415296:0@lo:103: 00010000:00010000:0.0:1782228850.253679:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003779800/0x8e1c8a3488e63509 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228851.069544:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228851.835818:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fd083f7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329415424:0@lo:400: 00000100:00100000:0.0:1782228851.835902:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228851.835981:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415424 00000100:00100000:0.0:1782228851.835989:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415424 00000100:00100000:0.0:1782228851.836035:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782228851.836045:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007526e1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:3311:x1868802329415424:12345-0@lo:400: 00000100:00100000:0.0:1782228851.836098:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007526e1c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:3311:x1868802329415424:12345-0@lo:400: Request processed in 56us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228851.836106:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782228851.836160:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fd083f7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329415424:0@lo:400: 00000100:00100000:2.0:1782228851.836341:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782228851.836389:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008d0ca012 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329415552:0@lo:400: 00000100:00100000:2.0:1782228851.836448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228851.836667:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415552 00000100:00100000:3.0:1782228851.836673:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415552 00000100:00100000:3.0:1782228851.836716:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782228851.836723:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088464acc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329415552:12345-0@lo:400: 00000100:00100000:3.0:1782228851.836772:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088464acc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329415552:12345-0@lo:400: Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228851.836779:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782228851.836853:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008d0ca012 x1868802329415552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228851.836866:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008d0ca012 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329415552:0@lo:400: 00010000:00010000:3.0:1782228852.091679:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228853.116642:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228854.140201:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782228854.402459:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782228854.402467:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe50300000 from 1 10000000:01000000:2.0:1782228854.402472:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782228854.402517:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: 00000000ba226156/0x8e1c8a3488e63510 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228854.402529:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: 00000000ba226156/0x8e1c8a3488e63510 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228854.402540:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: 00000000ba226156/0x8e1c8a3488e63510 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228854.402561:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e3691af0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329415680:0@lo:101: 00000100:00100000:2.0:1782228854.402626:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228854.402674:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ff741bb9 going to sleep for 11 seconds 00000100:00100000:3.0:1782228854.402797:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415680 00000100:00100000:3.0:1782228854.402804:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415680 00000100:00100000:3.0:1782228854.402857:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782228854.402864:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006229dd60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:5794:x1868802329415680:12345-0@lo:101: 00010000:00010000:3.0:1782228854.402877:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228854.402889:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011b13442/0x8e1c8a3488e63517 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63510 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228854.402910:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011b13442/0x8e1c8a3488e63517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228854.402920:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011b13442/0x8e1c8a3488e63517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228854.402928:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011b13442, rc 0) 00000100:00100000:3.0:1782228854.402973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006229dd60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329415680:12345-0@lo:101: Request processed in 110us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228854.402981:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782228854.403086:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e3691af0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329415680:0@lo:101: 00010000:00010000:2.0:1782228854.403099:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: 00000000ba226156/0x8e1c8a3488e63510 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228854.403107:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: 00000000ba226156/0x8e1c8a3488e63510 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228854.403193:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e3691af0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329415808:0@lo:501: 00000100:00100000:2.0:1782228854.403218:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228854.403247:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ff741bb9 going to sleep for 11 seconds 00000100:00100000:0.0:1782228854.403696:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415808 00000100:00100000:0.0:1782228854.403700:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415808 00000100:00100000:0.0:1782228854.403726:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782228854.403740:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055b1a900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329415808:12345-0@lo:501: 00000100:00100000:0.0:1782228854.404024:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055b1a900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329415808:12345-0@lo:501: Request processed in 284us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228854.404033:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782228854.404304:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e3691af0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329415808:0@lo:501: 00000100:00100000:2.0:1782228854.404341:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e3691af0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329415936:0@lo:503: 00000100:00100000:2.0:1782228854.404392:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228854.404425:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ff741bb9 going to sleep for 11 seconds 00000100:00100000:3.0:1782228854.405590:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329415936 00000100:00100000:3.0:1782228854.405597:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329415936 00000100:00100000:3.0:1782228854.405635:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782228854.405642:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff6cf21d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329415936:12345-0@lo:503: 00000100:00100000:3.0:1782228854.405926:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff6cf21d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329415936:12345-0@lo:503: Request processed in 284us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228854.405934:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782228854.405984:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e3691af0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329415936:0@lo:503: 00000100:00100000:3.0:1782228854.406167:0:6566:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cf0766ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6566:1868802329416064:0@lo:502: 00000100:00100000:3.0:1782228854.406204:0:6566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228854.406251:0:6566:0:(client.c:2701:ptlrpc_set_wait()) set 0000000044153bc6 going to sleep for 11 seconds 00000100:00100000:0.0:1782228854.408280:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416064 00000100:00100000:0.0:1782228854.409455:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416064 00000100:00100000:0.0:1782228854.409513:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782228854.409522:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002396fd42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6566:x1868802329416064:12345-0@lo:502: 00000100:00100000:0.0:1782228854.409812:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002396fd42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6566:x1868802329416064:12345-0@lo:502: Request processed in 290us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228854.409820:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782228854.409930:0:6566:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cf0766ea pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6566:1868802329416064:0@lo:502: 00000020:01000000:3.0:1782228854.409961:0:6566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782228854.409970:0:6566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228854.409972:0:6566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782228854.409978:0:6566:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe50300000 00000020:00000080:3.0:1782228854.409981:0:6566:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782228854.410028:0:6566:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6566:1868802329416192:0@lo:502: 00000100:00100000:3.0:1782228854.410070:0:6566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228854.410103:0:6566:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b840 going to sleep for 11 seconds 00000100:00100000:0.0:1782228854.410426:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416192 00000100:00100000:0.0:1782228854.410452:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416192 00000100:00100000:0.0:1782228854.410478:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782228854.410484:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6566:x1868802329416192:12345-0@lo:502: 00000100:00100000:0.0:1782228854.410603:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6566:x1868802329416192:12345-0@lo:502: Request processed in 118us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228854.410609:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782228854.410699:0:6566:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6566:1868802329416192:0@lo:502: 00000020:01000000:3.0:1782228854.410716:0:6566:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782228854.410721:0:6566:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228854.410722:0:6566:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782228854.410726:0:6566:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1782228854.410972:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782228854.410991:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782228854.411000:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228854.411011:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782228855.144098:0:6594:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782228855.144102:0:6594:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1782228855.144257:0:6594:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98fe7b8d6000 00000020:01000004:3.0:1782228855.144271:0:6594:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782228855.144282:0:6594:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782228855.144295:0:6594:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98fe74e3b380) 00000020:00000080:3.0:1782228855.144309:0:6594:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1782228855.163534:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1782228855.178619:0:6594:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782228855.178946:0:6594:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782228855.207125:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782228855.221593:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782228855.221630:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782228855.221688:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782228855.221716:0:6594:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782228855.223603:0:6594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782228855.223615:0:6594:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782228855.223625:0:6594:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e1c8a3488e63525 00000020:01000004:2.0:1782228855.223634:0:6594:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1782228855.223656:0:6594:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782228855.223660:0:6594:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782228855.223667:0:6594:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782228855.223671:0:6594:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782228855.223684:0:6594:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98fe68ea0000) 00000020:00000080:2.0:1782228855.223696:0:6594:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1782228855.228122:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782228855.230199:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782228855.230206:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782228855.241794:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782228855.241807:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782228855.242989:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1782228855.242997:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782228855.250738:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782228855.251001:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782228855.251009:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782228855.251849:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782228855.251857:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1782228855.279990:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782228855.280226:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782228855.280232:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782228855.282316:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782228855.282338:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782228855.283336:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782228855.283345:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1782228855.293896:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782228855.294191:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1782228855.294200:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1782228855.296705:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1782228855.296739:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782228855.350035:0:6594:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782228855.350769:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1782228855.350776:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1782228855.352106:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1782228855.352117:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1782228855.353947:0:6594:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1782228855.353972:0:6594:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1782228855.353977:0:6594:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782228855.380360:0:6594:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782228855.380403:0:6594:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.122@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1782228855.380408:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782228855.380409:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782228855.380411:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782228855.380412:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782228855.380414:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782228855.380415:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782228855.380417:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782228855.380418:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782228855.380420:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782228855.380421:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782228855.380422:0:6594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782228855.380426:0:6594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1782228855.380512:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782228855.380514:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782228855.380515:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782228855.380516:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782228855.380517:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782228855.380518:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782228855.380519:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782228855.380521:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782228855.380522:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782228855.380523:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782228855.380524:0:6594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782228855.380551:0:6594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782228855.380569:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329416320:0@lo:253: 00000100:00100000:0.0:1782228855.380650:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228855.380811:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416320 00000100:00100000:2.0:1782228855.380820:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416320 00000100:00100000:0.0:1782228855.380831:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782228855.381038:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782228855.381049:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329416320:12345-0@lo:253: 20000000:01000000:2.0:1782228855.381081:0:5790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782228855.381085:0:5790:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1782228855.381091:0:5790:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1782228855.381094:0:5790:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1782228855.382169:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228855.382337:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1782228855.382347:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1782228855.382370:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1782228855.382374:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1782228855.382389:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1782228855.382424:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1782228855.382854:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1782228855.382871:0:5790:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.122@tcp 20000000:01000000:2.0:1782228855.382872:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.122@tcp (null) (null) (null) 00000040:00080000:2.0:1782228855.382896:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1782228855.382901:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782228855.382926:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1782228855.382930:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.122@tcp (null) (null) 00000040:00080000:2.0:1782228855.382946:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1782228855.382951:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782228855.382964:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1782228855.382988:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1782228855.383831:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1782228855.383854:0:5790:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.122@tcp 20000000:01000000:3.0:1782228855.383856:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.122@tcp (null) (null) (null) 00000040:00080000:3.0:1782228855.383894:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1782228855.383902:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782228855.383937:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1782228855.383945:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.122@tcp (null) (null) 00000040:00080000:3.0:1782228855.383990:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1782228855.384000:0:5790:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782228855.384032:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1782228855.384067:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1782228855.384083:0:5790:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782228855.384086:0:5790:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782228855.384090:0:5790:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782228855.384100:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782228855.384103:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782228855.384154:0:5790:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782228855.384157:0:5790:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782228855.385666:0:6610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1782228855.386014:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1782228855.386062:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1782228855.386155:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1782228855.386169:0:5790:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782228855.386172:0:5790:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782228855.387323:0:6611:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1782228855.387469:0:6611:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1782228855.387526:0:6611:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1782228855.388120:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1782228855.388178:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1782228855.388538:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1782228855.388553:0:5790:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782228855.388556:0:5790:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782228855.389551:0:6612:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1782228855.389617:0:6612:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1782228855.389703:0:6612:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1782228855.393555:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1782228855.393601:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1782228855.393664:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1782228855.393684:0:5790:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1782228855.393687:0:5790:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1782228855.393696:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782228855.393714:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.393730:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6344c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.393737:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53378e00/0x8e1c8a3488e63468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.393743:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53378400/0x8e1c8a3488e634d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.393751:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.393787:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53378400/0x8e1c8a3488e634d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.393804:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53378400/0x8e1c8a3488e634d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 12 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228855.393817:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1868802329416448:0@lo:104: 00000100:00100000:0.0:1782228855.393877:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782228855.393944:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53378e00/0x8e1c8a3488e63468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.393952:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53378e00/0x8e1c8a3488e63468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 12 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228855.393960:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1868802329416576:0@lo:104: 00000100:00100000:0.0:1782228855.393981:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782228855.394016:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6344c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.394024:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6344c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 12 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228855.394031:0:5790:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1868802329416704:0@lo:104: 00000100:00100000:0.0:1782228855.394048:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228855.394057:0:5790:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43000 going to sleep for 11 seconds 00000100:00100000:3.0:1782228855.394098:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416448 00000100:00100000:3.0:1782228855.394111:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416448 00000100:00100000:3.0:1782228855.394157:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416576 00000100:00100000:3.0:1782228855.394160:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416576 00000100:00100000:3.0:1782228855.394169:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416704 00000100:00100000:3.0:1782228855.394172:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416704 00000100:00100000:3.0:1782228855.394184:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782228855.394192:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:5790:x1868802329416448:12345-0@lo:104: 00010000:00010000:3.0:1782228855.394205:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.394276:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782228855.394294:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:5790:x1868802329416448:12345-0@lo:104: Request processed in 103us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.394301:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782228855.394318:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782228855.394324:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:5790:x1868802329416576:12345-0@lo:104: 00010000:00010000:3.0:1782228855.394331:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.394370:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782228855.394375:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:5790:x1868802329416576:12345-0@lo:104: Request processed in 52us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.394381:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782228855.394393:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782228855.394399:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5790:x1868802329416704:12345-0@lo:104: 00010000:00010000:3.0:1782228855.394406:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394418:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782228855.394427:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.394459:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782228855.394470:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5790:x1868802329416704:12345-0@lo:104: Request processed in 71us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.394477:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1782228855.394499:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782228855.394501:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82051200 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782228855.394507:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394516:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782228855.394523:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228855.394529:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782228855.394568:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394575:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782228855.394604:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329416832:0@lo:103: 00010000:00010000:1.0:1782228855.394604:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394611:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e634d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634d8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394622:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782228855.394625:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394631:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53379c00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782228855.394633:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228855.394638:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228855.394640:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782228855.394646:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228855.394651:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782228855.394667:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394673:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782228855.394690:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394697:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e63445 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6344c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.394707:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228855.394714:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228855.394716:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228855.394726:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782228855.394735:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329416960:0@lo:103: 00000100:00100000:1.0:1782228855.394761:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228855.394879:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416832 00000100:00100000:0.0:1782228855.394884:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416832 00000100:00100000:2.0:1782228855.394888:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329416960 00000100:00100000:2.0:1782228855.394891:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329416960 00010000:00010000:0.0:1782228855.394902:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53378400/0x8e1c8a3488e634d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 14 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.394903:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6344c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228855.394933:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782228855.394940:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3311:x1868802329416960:12345-0@lo:103: 00010000:00010000:2.0:1782228855.394950:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782228855.394954:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6344c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.394963:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6344c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.394977:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782228855.395005:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3311:x1868802329416960:12345-0@lo:103: Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.395011:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782228855.395023:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782228855.395030:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:3309:x1868802329416832:12345-0@lo:103: 00010000:00010000:2.0:1782228855.395037:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782228855.395041:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53378400/0x8e1c8a3488e634d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 13 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.395051:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53378400/0x8e1c8a3488e634d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 13 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.395060:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782228855.395087:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:3309:x1868802329416832:12345-0@lo:103: Request processed in 57us (448us total) trans 0 rc 0/0 00010000:00010000:3.0:1782228855.395088:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228855.395096:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.395112:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030000 already unused, calling callback (ffffffffc1d50c20) 00000100:00100000:2.0:1782228855.395115:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:00010000:3.0:1782228855.395118:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.395138:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782228855.395145:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228855.395151:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782228855.395164:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329416832:0@lo:103: 00010000:00010000:0.0:1782228855.395165:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53378400/0x8e1c8a3488e634d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e634d1 expref: 12 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.395178:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228855.395179:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1868802329416448:0@lo:104: 00010000:00010000:3.0:1782228855.395190:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782228855.395195:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1868802329416576:0@lo:104: 00010000:00010000:3.0:1782228855.395212:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.395212:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6344c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63445 expref: 11 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.395224:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329417088:0@lo:103: 00000100:00100000:0.0:1782228855.395240:0:5790:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5790:1868802329416704:0@lo:104: 00010000:00010000:0.0:1782228855.395257:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.395258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.395279:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329416960:0@lo:103: 00000100:00100000:1.0:1782228855.395305:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417088 00000100:00100000:1.0:1782228855.395308:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417088 00010000:00010000:1.0:1782228855.395322:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53378e00/0x8e1c8a3488e63468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 11 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.395348:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782228855.395355:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:3311:x1868802329417088:12345-0@lo:103: 00010000:00010000:1.0:1782228855.395361:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782228855.395365:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53378e00/0x8e1c8a3488e63468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 11 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395374:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53378e00/0x8e1c8a3488e63468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 11 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395384:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53378e00/0x8e1c8a3488e63468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63461 expref: 11 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395395:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395402:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395420:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395426:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395462:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395468:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395474:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782228855.395477:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395483:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395495:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.395502:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782228855.395531:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:3311:x1868802329417088:12345-0@lo:103: Request processed in 176us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228855.395537:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782228855.395561:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329417088:0@lo:103: 00010000:00010000:0.0:1782228855.395667:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.395686:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.395692:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e63533 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782228855.395705:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1782228855.396058:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe40030000/0x8e1c8a3488e63461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63468 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.396074:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228855.396077:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228855.396088:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228855.396106:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228855.396109:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228855.435076:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:6594:x1868802329416320:12345-0@lo:253: Request processed in 54018us (54415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228855.435238:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782228855.435379:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329416320:0@lo:253: 10000000:01000000:0.0:1782228855.435391:0:6594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782228855.435393:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782228855.435394:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782228855.435395:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782228855.435396:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1782228855.435397:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782228855.435398:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782228855.435399:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782228855.435400:0:6594:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782228855.435401:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782228855.435402:0:6594:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782228855.435419:0:6594:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fe7b8d6000 from lustre-OST0000 10000000:01000000:0.0:1782228855.435457:0:6594:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782228855.435460:0:6594:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782228855.435468:0:6594:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98fe68ea3380 local copy 10000000:01000000:0.0:1782228855.435472:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782228855.435516:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.435526:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.435534:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228855.435548:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417216:0@lo:101: 00000100:00100000:0.0:1782228855.435575:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228855.435651:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43180 going to sleep for 11 seconds 00000100:00100000:3.0:1782228855.435707:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417216 00000100:00100000:3.0:1782228855.435713:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417216 00000100:00100000:3.0:1782228855.435786:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782228855.435794:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:6594:x1868802329417216:12345-0@lo:101: 00010000:00010000:3.0:1782228855.435807:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228855.435820:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53378200/0x8e1c8a3488e63541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6353a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.435842:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53378200/0x8e1c8a3488e63541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6353a expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.435852:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53378200/0x8e1c8a3488e63541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6353a expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.435859:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53378200, rc 0) 00000100:00100000:3.0:1782228855.435922:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:6594:x1868802329417216:12345-0@lo:101: Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.435927:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782228855.436042:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417216:0@lo:101: 00010000:00010000:1.0:1782228855.436051:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.436057:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.436293:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417344:0@lo:501: 00000100:00100000:1.0:1782228855.436319:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.436474:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666300 going to sleep for 11 seconds 00000100:00100000:0.0:1782228855.436567:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417344 00000100:00100000:0.0:1782228855.436572:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417344 00000100:00100000:0.0:1782228855.436606:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782228855.436614:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:6594:x1868802329417344:12345-0@lo:501: 00000100:00100000:0.0:1782228855.436909:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:6594:x1868802329417344:12345-0@lo:501: Request processed in 296us (589us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782228855.436916:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782228855.437036:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417344:0@lo:501: 10000000:01000000:1.0:1782228855.437051:0:6594:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782228855.437078:0:6594:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782228855.437084:0:6594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437092:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437100:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437295:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782228855.437320:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fe7b8d6000 10000000:01000000:1.0:1782228855.437334:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782228855.437339:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98fe68ea3380 10000000:01000000:1.0:1782228855.437350:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782228855.437354:0:6594:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff98fe68ea3380 from 1 10000000:01000000:1.0:1782228855.437357:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782228855.437378:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437387:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437395:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.437409:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417472:0@lo:101: 00000100:00100000:1.0:1782228855.437473:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.437501:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666840 going to sleep for 11 seconds 00000100:00100000:3.0:1782228855.437559:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417472 00000100:00100000:3.0:1782228855.437566:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417472 00000100:00100000:3.0:1782228855.437591:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782228855.437597:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+10:6594:x1868802329417472:12345-0@lo:101: 00010000:00010000:3.0:1782228855.437607:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228855.437619:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53379800/0x8e1c8a3488e6354f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63548 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.437638:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53379800/0x8e1c8a3488e6354f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63548 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.437655:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53379800/0x8e1c8a3488e6354f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63548 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.437663:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53379800, rc 0) 00000100:00100000:3.0:1782228855.437700:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329417472:12345-0@lo:101: Request processed in 104us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.437706:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782228855.437815:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417472:0@lo:101: 00010000:00010000:1.0:1782228855.437827:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6354f expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437835:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6354f expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228855.437849:0:6594:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782228855.437864:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6354f expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437871:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6354f expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228855.437878:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782228855.437887:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782228855.437892:0:6594:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782228855.437894:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782228855.437907:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437914:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.437921:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.437932:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417600:0@lo:101: 00000100:00100000:1.0:1782228855.437956:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.438070:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666840 going to sleep for 11 seconds 00010000:00010000:2.0:1782228855.438402:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782228855.438410:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.438418:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030400 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:2.0:1782228855.438421:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.438489:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782228855.438498:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782228855.438504:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782228855.438525:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.438531:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782228855.438574:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329417728:0@lo:103: 00000100:00100000:1.0:1782228855.438607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782228855.438659:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.438667:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e6353a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e1c8a3488e63541 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.438681:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228855.438682:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228855.438691:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228855.438745:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417728 00000100:00100000:3.0:1782228855.438751:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417728 00000100:00100000:3.0:1782228855.438795:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782228855.438802:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:3308:x1868802329417728:12345-0@lo:103: 00010000:00010000:3.0:1782228855.438812:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228855.438824:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53378200/0x8e1c8a3488e63541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e6353a expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228855.438837:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228855.438942:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417600 00000100:00100000:0.0:1782228855.438947:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417600 00000100:00100000:0.0:1782228855.438983:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782228855.438990:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329417600:12345-0@lo:101: 00010000:00010000:0.0:1782228855.438999:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228855.439010:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63556 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.439026:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.439047:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.439055:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030000, rc 0) 00000100:00100000:0.0:1782228855.439088:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329417600:12345-0@lo:101: Request processed in 99us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228855.439094:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782228855.439563:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:3308:x1868802329417728:12345-0@lo:103: Request processed in 761us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228855.439566:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329417728:0@lo:103: 00000100:00100000:3.0:1782228855.439570:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782228855.439595:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417600:0@lo:101: 00010000:00010000:1.0:1782228855.439618:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.439627:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.439721:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417856:0@lo:501: 00000100:00100000:1.0:1782228855.439750:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.439783:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666840 going to sleep for 11 seconds 00000100:00100000:0.0:1782228855.439876:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417856 00000100:00100000:0.0:1782228855.439881:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417856 00000100:00100000:0.0:1782228855.439908:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782228855.439915:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329417856:12345-0@lo:501: 00000100:00100000:0.0:1782228855.440289:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329417856:12345-0@lo:501: Request processed in 373us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228855.440296:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782228855.440320:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417856:0@lo:501: 00000100:00100000:1.0:1782228855.440389:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417984:0@lo:503: 00000100:00100000:1.0:1782228855.440454:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.440475:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666840 going to sleep for 11 seconds 00000100:00100000:3.0:1782228855.440523:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329417984 00000100:00100000:3.0:1782228855.440527:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329417984 00000100:00100000:3.0:1782228855.440563:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782228855.440570:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329417984:12345-0@lo:503: 00000100:00100000:3.0:1782228855.440762:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329417984:12345-0@lo:503: Request processed in 193us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.440767:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782228855.440832:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329417984:0@lo:503: 00000040:00080000:1.0:1782228855.441282:0:6594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782228855.441352:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418112:0@lo:502: 00000100:00100000:1.0:1782228855.441396:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.441425:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666840 going to sleep for 11 seconds 00000100:00100000:0.0:1782228855.441514:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329418112 00000100:00100000:0.0:1782228855.441520:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329418112 00000100:00100000:0.0:1782228855.441552:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782228855.441556:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329418112:12345-0@lo:502: 00000100:00100000:0.0:1782228855.441738:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329418112:12345-0@lo:502: Request processed in 180us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228855.441745:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782228855.441767:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418112:0@lo:502: 00000040:00080000:1.0:1782228855.442070:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782228855.442260:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782228855.442291:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782228855.442338:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782228855.442371:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782228855.442411:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782228855.442703:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418240:0@lo:502: 00000100:00100000:1.0:1782228855.442760:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.442794:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666840 going to sleep for 11 seconds 00000100:00100000:3.0:1782228855.442802:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329418240 00000100:00100000:3.0:1782228855.442816:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329418240 00000100:00100000:3.0:1782228855.442855:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782228855.442863:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329418240:12345-0@lo:502: 00000100:00100000:3.0:1782228855.443106:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329418240:12345-0@lo:502: Request processed in 243us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.443113:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782228855.443274:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418240:0@lo:502: 00000040:00080000:1.0:1782228855.443353:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782228855.443361:0:6594:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1782228855.444381:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782228855.444392:0:6614:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1782228855.444400:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228855.444403:0:6614:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1782228855.444408:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782228855.444642:0:6614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98fe77bc0000) 00000020:00000080:1.0:1782228855.444674:0:6614:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782228855.444682:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782228855.444793:0:6614:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fe7b8d6000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1782228855.444801:0:6614:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782228855.444809:0:6614:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e1c8a3488e6356b 00010000:00010000:1.0:1782228855.451629:0:6614:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1782228855.451998:0:6614:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1782228855.454598:0:6614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1782228855.454930:0:6614:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782228855.461158:0:6614:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782228855.461736:0:6614:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782228855.463107:0:6614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782228855.463119:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782228855.463141:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228855.463143:0:6614:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782228855.463147:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782228855.463150:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228855.463159:0:6614:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782228855.463163:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782228855.463165:0:6614:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782228855.463218:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782228855.463222:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228855.463224:0:6614:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782228855.463226:0:6614:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782228855.463497:0:6594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1782228855.463522:0:6594:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782228855.463543:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.463556:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782228855.463564:0:6594:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7b8d6000 from 1 10000000:01000000:2.0:1782228855.463567:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782228855.463665:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.463674:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.463684:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228855.463708:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418368:0@lo:101: 00000100:00100000:2.0:1782228855.463776:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228855.463827:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4465c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228855.463902:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329418368 00000100:00100000:0.0:1782228855.463911:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329418368 00000100:00100000:0.0:1782228855.464085:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782228855.464095:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:6594:x1868802329418368:12345-0@lo:101: 00010000:00010000:0.0:1782228855.464108:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228855.464121:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63572 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.464426:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.464525:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.464534:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031600, rc 0) 00000100:00100000:0.0:1782228855.464656:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418368:12345-0@lo:101: Request processed in 484us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228855.464665:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782228855.464807:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418368:0@lo:101: 00010000:00010000:2.0:1782228855.464824:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.464833:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228855.465082:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418496:0@lo:501: 00000100:00100000:2.0:1782228855.465115:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228855.465397:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4465c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228855.465700:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329418496 00000100:00100000:3.0:1782228855.465707:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329418496 00000100:00100000:3.0:1782228855.465787:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782228855.465795:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418496:12345-0@lo:501: 00000100:00100000:3.0:1782228855.466057:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418496:12345-0@lo:501: Request processed in 262us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.466064:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782228855.466135:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418496:0@lo:501: 00000100:00100000:1.0:1782228855.466173:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418624:0@lo:503: 00000100:00100000:1.0:1782228855.466213:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.466247:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228855.466300:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329418624 00000100:00100000:2.0:1782228855.466304:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329418624 00000100:00100000:2.0:1782228855.466333:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782228855.466340:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418624:12345-0@lo:503: 00000100:00100000:2.0:1782228855.466528:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418624:12345-0@lo:503: Request processed in 187us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.466535:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782228855.466628:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418624:0@lo:503: 00000040:00080000:1.0:1782228855.466885:0:6594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782228855.466938:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418752:0@lo:502: 00000100:00100000:1.0:1782228855.466976:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.467007:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228855.467089:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329418752 00000100:00100000:3.0:1782228855.467093:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329418752 00000100:00100000:3.0:1782228855.467170:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782228855.467177:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418752:12345-0@lo:502: 00000100:00100000:3.0:1782228855.467320:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418752:12345-0@lo:502: Request processed in 142us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228855.467327:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782228855.467390:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418752:0@lo:502: 00000040:00080000:1.0:1782228855.467647:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782228855.467697:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782228855.467721:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418880:0@lo:502: 00000100:00100000:1.0:1782228855.467757:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.467881:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228855.467912:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329418880 00000100:00100000:2.0:1782228855.467917:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329418880 00000100:00100000:2.0:1782228855.467938:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782228855.467944:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418880:12345-0@lo:502: 00000100:00100000:2.0:1782228855.468073:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329418880:12345-0@lo:502: Request processed in 128us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.468079:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782228855.468206:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329418880:0@lo:502: 00000040:00080000:1.0:1782228855.468282:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782228855.468298:0:6594:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782228855.468773:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228855.468783:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228855.468786:0:6618:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782228855.468793:0:6618:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe7b8d6000 00000020:00000080:2.0:1782228855.468797:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782228855.468816:0:6618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228855.468819:0:6618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228855.468821:0:6618:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782228855.468824:0:6618:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782228855.468960:0:6594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782228855.468981:0:6594:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782228855.469043:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.469055:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228855.469094:0:6594:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782228855.469097:0:6594:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fe7b8d6000 10000000:01000000:1.0:1782228855.469100:0:6594:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fe7b8d6000 10000000:01000000:1.0:1782228855.469104:0:6594:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782228855.469111:0:6594:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe7b8d6000 from 1 10000000:01000000:1.0:1782228855.469114:0:6594:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782228855.469156:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.469165:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.469175:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.469193:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419008:0@lo:101: 00000100:00100000:1.0:1782228855.469234:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.469268:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228855.469311:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419008 00000100:00100000:2.0:1782228855.469322:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419008 00000100:00100000:2.0:1782228855.469363:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782228855.469370:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329419008:12345-0@lo:101: 00010000:00010000:2.0:1782228855.469383:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228855.469395:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63580 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.469418:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.469452:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.469461:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b3600, rc 0) 00000100:00100000:2.0:1782228855.469495:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419008:12345-0@lo:101: Request processed in 125us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.469501:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782228855.469589:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419008:0@lo:101: 00010000:00010000:1.0:1782228855.469603:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.469620:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228855.469703:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419136:0@lo:501: 00000100:00100000:1.0:1782228855.469727:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.469754:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228855.469790:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419136 00000100:00100000:2.0:1782228855.469794:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419136 00000100:00100000:2.0:1782228855.469814:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782228855.469819:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419136:12345-0@lo:501: 00000100:00100000:2.0:1782228855.470030:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419136:12345-0@lo:501: Request processed in 210us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.470038:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782228855.470095:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419136:0@lo:501: 00000100:00100000:1.0:1782228855.470120:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419264:0@lo:503: 00000100:00100000:1.0:1782228855.470167:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.470188:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228855.470224:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419264 00000100:00100000:2.0:1782228855.470228:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419264 00000100:00100000:2.0:1782228855.470255:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782228855.470261:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419264:12345-0@lo:503: 00000100:00100000:2.0:1782228855.470390:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419264:12345-0@lo:503: Request processed in 128us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.470401:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782228855.470694:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419264:0@lo:503: 00000040:00080000:0.0:1782228855.471733:0:6594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782228855.471813:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419392:0@lo:502: 00000100:00100000:0.0:1782228855.471880:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228855.471920:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782228855.471988:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419392 00000100:00100000:2.0:1782228855.471995:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419392 00000100:00100000:2.0:1782228855.472072:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782228855.472081:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419392:12345-0@lo:502: 00000100:00100000:2.0:1782228855.472293:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419392:12345-0@lo:502: Request processed in 212us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.472300:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782228855.472388:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419392:0@lo:502: 00000040:00080000:0.0:1782228855.472864:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782228855.472913:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782228855.473055:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782228855.473103:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782228855.473318:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782228855.473369:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782228855.473401:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782228855.473451:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782228855.473504:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782228855.473539:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782228855.473569:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782228855.473645:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782228855.473680:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782228855.473722:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782228855.473770:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782228855.473807:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782228855.473842:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782228855.473897:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782228855.473935:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782228855.473996:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782228855.474062:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782228855.474096:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782228855.474143:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782228855.474191:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782228855.474238:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1782228855.474274:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1782228855.474343:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1782228855.474381:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1782228855.474427:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419520:0@lo:502: 00000100:00100000:0.0:1782228855.474526:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228855.474572:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782228855.474599:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419520 00000100:00100000:1.0:1782228855.474606:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419520 00000100:00100000:1.0:1782228855.474655:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782228855.474665:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419520:12345-0@lo:502: 00000100:00100000:1.0:1782228855.474868:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419520:12345-0@lo:502: Request processed in 204us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228855.474875:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782228855.475358:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419520:0@lo:502: 00000040:00080000:0.0:1782228855.475628:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1782228855.475642:0:6594:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1782228855.476959:0:6619:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1782228855.476974:0:6619:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98fe66020000) 00000020:00000080:0.0:1782228855.476993:0:6619:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1782228855.477171:0:6619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fe7b8d6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782228855.477175:0:6619:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fe7b8d6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782228855.477177:0:6619:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe7b8d6000 3 00010000:00080000:0.0:1782228855.477215:0:6619:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe7fe2e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.122@tcp at head 00010000:00010000:0.0:1782228855.482119:0:6619:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1782228855.482266:0:6619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1782228855.482316:0:6619:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782228855.482329:0:6619:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8e1c8a3488e63595 00000100:00080000:0.0:1782228855.482340:0:6619:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782228855.482347:0:6619:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98fe7fe2e000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782228855.482380:0:6619:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe446ace00 x1868802329419648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782228855.482411:0:6619:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782228855.482764:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782228855.482779:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329419776:0@lo:400: 00000100:00100000:1.0:1782228855.482850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228855.482901:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419776 00000100:00100000:1.0:1782228855.482907:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419776 00000100:00100000:1.0:1782228855.482950:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782228855.482958:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329419776:12345-0@lo:400: 00000100:00100000:1.0:1782228855.483012:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329419776:12345-0@lo:400: Request processed in 54us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228855.483028:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782228855.483072:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fe74e78700 x1868802329419776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228855.483086:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329419776:0@lo:400: 00000100:00100000:2.0:1782228855.483550:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1868802329419648:0@lo:38: 00000100:00100000:2.0:1782228855.483591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228855.483640:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419648 00000100:00100000:2.0:1782228855.483645:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419648 00000100:00100000:2.0:1782228855.483673:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782228855.483678:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1868802329419648:12345-0@lo:38: 00010000:00080000:2.0:1782228855.483702:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1782228855.483735:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8e1c8a3488e6359c 00000004:00100000:2.0:1782228855.483752:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782228855.483786:0:5796:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe6b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782228855.483828:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868802329419648:12345-0@lo:38: Request processed in 148us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228855.483835:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782228855.483867:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fe446ace00 x1868802329419648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782228865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228855.483876:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782228855.483882:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1782228855.483889:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782228855.483903:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782228855.483905:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782228855.483912:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1868802329419648:0@lo:38: 00000040:00080000:1.0:1782228855.486873:0:6619:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1782228855.492931:0:6594:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1782228855.492967:0:6594:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782228855.492994:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.493006:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782228855.493384:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782228855.493386:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782228855.493387:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782228855.493389:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782228855.493390:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782228855.493392:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782228855.493393:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782228855.493394:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782228855.493396:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782228855.493397:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782228855.493399:0:6594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782228855.493402:0:6594:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1782228855.493404:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782228855.493406:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782228855.493407:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782228855.493408:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782228855.493409:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782228855.493410:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782228855.493411:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782228855.493412:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782228855.493413:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782228855.493414:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782228855.493415:0:6594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782228855.493704:0:6594:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782228855.493733:0:6594:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419904:0@lo:253: 00000100:00100000:2.0:1782228855.493806:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228855.493845:0:6594:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4465ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1782228855.493893:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329419904 00000100:00100000:0.0:1782228855.493899:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329419904 00000100:00100000:0.0:1782228855.493980:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782228855.493990:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6594:x1868802329419904:12345-0@lo:253: 20000000:01000000:0.0:1782228855.494020:0:5791:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782228855.494034:0:5791:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782228855.527921:0:5791:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782228855.527943:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782228855.528058:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782228855.528063:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782228855.528087:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.528105:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e634fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.528116:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.528857:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e634fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228855.528879:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e634fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 13 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228855.528897:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1868802329420032:0@lo:104: 00000100:00100000:2.0:1782228855.529463:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228855.529534:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe505bfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782228855.529558:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420032 00000100:00100000:0.0:1782228855.529583:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420032 00000100:00100000:0.0:1782228855.529632:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782228855.529642:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5812:x1868802329420032:12345-0@lo:104: 00010000:00010000:0.0:1782228855.529656:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.529729:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782228855.529737:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5812:x1868802329420032:12345-0@lo:104: Request processed in 96us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228855.529745:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782228855.529759:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1868802329420032:0@lo:104: 00010000:00010000:0.0:1782228855.529770:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228855.529776:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228855.529783:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.529786:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82051000 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228855.529793:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.530928:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228855.530937:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228855.530945:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228855.531060:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531079:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228855.531105:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531134:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e634f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e634fb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531159:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228855.531162:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329420160:0@lo:103: 00010000:00010000:0.0:1782228855.531162:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228855.531167:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228855.531231:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228855.531366:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420160 00000100:00100000:0.0:1782228855.531372:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420160 00010000:00010000:0.0:1782228855.531395:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e634fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228855.531461:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782228855.531470:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3310:x1868802329420160:12345-0@lo:103: 00010000:00010000:0.0:1782228855.531482:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228855.531488:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e634fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531501:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e634fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531515:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e634fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e634f4 expref: 14 pid: 5791 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531529:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531538:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782228855.531562:0:5783:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003499624s 00010000:00010000:0.0:1782228855.531567:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531574:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531580:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531588:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531594:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe605b2000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782228855.531599:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531607:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531623:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531633:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228855.531683:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:3310:x1868802329420160:12345-0@lo:103: Request processed in 214us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228855.531692:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782228855.531711:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329420160:0@lo:103: 00010000:00010000:0.0:1782228855.531762:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531780:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228855.531786:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e635a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228855.538883:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:6594:x1868802329419904:12345-0@lo:253: Request processed in 44884us (45066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228855.538899:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782228855.538911:0:6594:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6594:1868802329419904:0@lo:253: 10000000:01000000:2.0:1782228855.538929:0:6594:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782228855.538932:0:6594:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782228855.538934:0:6594:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782228855.538935:0:6594:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782228855.538937:0:6594:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782228855.538938:0:6594:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782228855.538939:0:6594:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782228855.538941:0:6594:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782228855.538970:0:6594:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782228855.538971:0:6594:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782228855.538973:0:6594:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782228855.538975:0:6594:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782228855.538989:0:6594:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782228855.545192:0:6594:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782228855.545377:0:6594:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782228855.545644:0:6594:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782228855.545834:0:6594:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782228855.546051:0:6594:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782228855.546285:0:6594:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782228855.548959:0:6594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782228855.766817:0:6594:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1782228855.766824:0:6594:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1782228855.766869:0:6594:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782228855.766923:0:6594:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782228855.766942:0:6594:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782228855.766974:0:6594:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1782228856.190532:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228857.211923:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228858.244343:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228859.264088:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228860.283607:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228860.539968:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782228860.540002:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329420288:0@lo:400: 00000100:00100000:2.0:1782228860.540117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228860.540192:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329420544:0@lo:400: 00000100:00100000:2.0:1782228860.540223:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228860.540242:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782228860.540247:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329420416:0@lo:400: 00000100:00100000:2.0:1782228860.540269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228860.540300:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420288 00000100:00100000:2.0:1782228860.540308:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420288 00000100:00100000:2.0:1782228860.540356:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782228860.540366:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:3310:x1868802329420288:12345-0@lo:400: 00000100:00100000:2.0:1782228860.540421:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:3310:x1868802329420288:12345-0@lo:400: Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228860.540463:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782228860.540504:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420544 00000100:00100000:2.0:1782228860.540507:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420544 00000100:00100000:1.0:1782228860.541002:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420416 00000100:00100000:1.0:1782228860.541007:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420416 00000100:00100000:1.0:1782228860.541053:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782228860.541061:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329420416:12345-0@lo:400: 00000100:00100000:1.0:1782228860.541129:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329420416:12345-0@lo:400: Request processed in 69us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228860.541136:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782228860.541417:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe50c8f480 x1868802329420416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228860.541463:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329420416:0@lo:400: 00000100:00080000:0.0:1782228860.541601:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228860.541624:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329420288:0@lo:400: 00000100:00100000:2.0:1782228860.542003:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782228860.542015:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329420544:12345-0@lo:400: 00000100:00100000:2.0:1782228860.542088:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329420544:12345-0@lo:400: Request processed in 78us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228860.542095:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782228860.542665:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe50c8df80 x1868802329420544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228860.542679:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329420544:0@lo:400: 00010000:00010000:0.0:1782228861.308094:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782228861.565155:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782228861.565165:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe50300000 from 21 10000000:01000000:3.0:1782228861.565170:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782228861.565221:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228861.565232:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228861.565243:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228861.565266:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329420672:0@lo:101: 00000100:00100000:3.0:1782228861.565335:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228861.565391:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe506be0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228861.565535:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420672 00000100:00100000:1.0:1782228861.565543:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420672 00000100:00100000:1.0:1782228861.565595:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782228861.565603:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329420672:12345-0@lo:101: 00010000:00010000:1.0:1782228861.565616:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228861.565629:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e635aa expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.565651:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.565673:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.565682:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051600, rc 0) 00000100:00100000:1.0:1782228861.565720:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329420672:12345-0@lo:101: Request processed in 117us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228861.565726:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782228861.565851:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329420672:0@lo:101: 00010000:00010000:3.0:1782228861.565866:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228861.565874:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228861.565927:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329420800:0@lo:501: 00000100:00100000:3.0:1782228861.566038:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228861.566110:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe506be0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228861.566794:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420800 00000100:00100000:0.0:1782228861.566800:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420800 00000100:00100000:0.0:1782228861.566864:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782228861.566872:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329420800:12345-0@lo:501: 00000100:00100000:0.0:1782228861.567248:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329420800:12345-0@lo:501: Request processed in 376us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.567255:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782228861.571856:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329420800:0@lo:501: 00000100:00100000:1.0:1782228861.572881:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329420928:0@lo:503: 00000100:00100000:1.0:1782228861.573258:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.573670:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe445fc240 going to sleep for 11 seconds 00000100:00100000:0.0:1782228861.573752:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329420928 00000100:00100000:0.0:1782228861.573759:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329420928 00000100:00100000:0.0:1782228861.573811:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782228861.573821:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329420928:12345-0@lo:503: 00000100:00100000:0.0:1782228861.574338:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329420928:12345-0@lo:503: Request processed in 516us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.574347:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782228861.574495:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329420928:0@lo:503: 00000100:00100000:0.0:1782228861.576232:0:6945:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6945:1868802329421056:0@lo:502: 00000100:00100000:3.0:1782228861.576942:0:6945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228861.576991:0:6945:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898840 going to sleep for 11 seconds 00000100:00100000:0.0:1782228861.577995:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421056 00000100:00100000:0.0:1782228861.578014:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421056 00000100:00100000:0.0:1782228861.578072:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782228861.578081:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6945:x1868802329421056:12345-0@lo:502: 00000100:00100000:0.0:1782228861.578706:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6945:x1868802329421056:12345-0@lo:502: Request processed in 623us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.578779:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782228861.579064:0:6945:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6945:1868802329421056:0@lo:502: 00000100:00100000:1.0:1782228861.579126:0:6945:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6945:1868802329421184:0@lo:502: 00000100:00100000:1.0:1782228861.579170:0:6945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.579205:0:6945:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44d4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1782228861.579252:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421184 00000100:00100000:0.0:1782228861.579257:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421184 00000100:00100000:0.0:1782228861.579701:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782228861.579719:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6945:x1868802329421184:12345-0@lo:502: 00000100:00100000:0.0:1782228861.579905:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:6945:x1868802329421184:12345-0@lo:502: Request processed in 196us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.579913:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782228861.580068:0:6945:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6945:1868802329421184:0@lo:502: 00000040:00080000:2.0:1782228861.580159:0:6945:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1782228861.580218:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1782228861.580237:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782228861.580246:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228861.580256:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782228861.580266:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782228861.580268:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fe50300000 from 4 10000000:01000000:2.0:1782228861.580271:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782228861.580299:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228861.580308:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228861.580317:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228861.580338:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421312:0@lo:101: 00000100:00100000:2.0:1782228861.580369:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228861.582327:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe505bf900 going to sleep for 11 seconds 00000100:00100000:1.0:1782228861.583804:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421312 00000100:00100000:1.0:1782228861.583817:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421312 00000100:00100000:1.0:1782228861.583873:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782228861.583884:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329421312:12345-0@lo:101: 00010000:00010000:1.0:1782228861.583900:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228861.583919:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e635b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.583946:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.586054:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.586065:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82050200, rc 0) 00000100:00100000:1.0:1782228861.586204:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329421312:12345-0@lo:101: Request processed in 2320us (5831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228861.586213:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782228861.586293:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421312:0@lo:101: 00010000:00010000:1.0:1782228861.586314:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.586324:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228861.586394:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421440:0@lo:256: 00000100:00100000:1.0:1782228861.586454:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.586485:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65f71300 going to sleep for 11 seconds 00000100:00100000:1.0:1782228861.586507:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421440 00000100:00100000:1.0:1782228861.586513:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421440 00000100:00100000:1.0:1782228861.586540:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782228861.586548:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329421440:12345-0@lo:256: 20000000:01000000:1.0:1782228861.586569:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782228861.586584:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782228861.586587:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1782228861.586666:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329421440:12345-0@lo:256: Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228861.586673:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782228861.586709:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421440:0@lo:256: 10000000:01000000:1.0:1782228861.586754:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782228861.586762:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.586771:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228861.586781:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782228861.586783:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1782228861.586786:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782228861.586809:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.586817:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.586827:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228861.586840:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421568:0@lo:101: 00000100:00100000:1.0:1782228861.586863:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.586876:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b000 going to sleep for 11 seconds 00000100:00100000:1.0:1782228861.586887:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421568 00000100:00100000:1.0:1782228861.586890:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421568 00000100:00100000:1.0:1782228861.586906:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782228861.586912:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329421568:12345-0@lo:101: 00010000:00010000:1.0:1782228861.586921:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228861.586932:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e635c6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.587325:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.587335:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.587342:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051000, rc 0) 00000100:00100000:1.0:1782228861.587374:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329421568:12345-0@lo:101: Request processed in 461us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228861.587380:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782228861.588058:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421568:0@lo:101: 00010000:00010000:1.0:1782228861.588073:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228861.588081:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228861.588201:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421696:0@lo:501: 00000100:00100000:1.0:1782228861.588232:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.588256:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b000 going to sleep for 11 seconds 00000100:00100000:1.0:1782228861.588276:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421696 00000100:00100000:1.0:1782228861.588280:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421696 00000100:00100000:1.0:1782228861.588301:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782228861.588307:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329421696:12345-0@lo:501: 00000100:00100000:1.0:1782228861.588575:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329421696:12345-0@lo:501: Request processed in 267us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228861.588583:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782228861.588625:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421696:0@lo:501: 00000100:00100000:1.0:1782228861.588655:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421824:0@lo:503: 00000100:00100000:1.0:1782228861.588695:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.588724:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b000 going to sleep for 11 seconds 00000100:00100000:0.0:1782228861.588833:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421824 00000100:00100000:0.0:1782228861.588839:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421824 00000100:00100000:0.0:1782228861.588877:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782228861.588887:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329421824:12345-0@lo:503: 00000100:00100000:0.0:1782228861.591880:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329421824:12345-0@lo:503: Request processed in 2985us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.591894:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782228861.592251:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329421824:0@lo:503: 00000100:00100000:3.0:1782228861.601033:0:6949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6949:1868802329421952:0@lo:502: 00000100:00100000:3.0:1782228861.601151:0:6949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228861.601195:0:6949:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe445fc240 going to sleep for 11 seconds 00000100:00100000:2.0:1782228861.601811:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329421952 00000100:00100000:2.0:1782228861.601821:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329421952 00000100:00100000:2.0:1782228861.601876:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782228861.601885:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:6949:x1868802329421952:12345-0@lo:502: 00000100:00100000:2.0:1782228861.602362:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:6949:x1868802329421952:12345-0@lo:502: Request processed in 476us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228861.602370:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782228861.602844:0:6949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6949:1868802329421952:0@lo:502: 00000020:01000000:2.0:1782228861.602882:0:6949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782228861.602890:0:6949:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782228861.602898:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228861.602901:0:6949:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782228861.602906:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782228861.602910:0:6949:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.122@tcp to nid 0x20000c0a8cc7a (192.168.204.122@tcp) 00000020:01000000:2.0:1782228861.602932:0:6949:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782228861.602935:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782228861.603053:0:6949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98fe7fffb380) 00000020:00000080:2.0:1782228861.603075:0:6949:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1782228861.603082:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782228861.603233:0:6949:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782228861.603238:0:6949:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1782228861.603244:0:6949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e635db 00010000:00080000:2.0:1782228861.603276:0:6949:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe7d897000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.122@tcp at head 00010000:00010000:2.0:1782228861.603709:0:6949:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782228861.681970:0:6949:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782228861.681994:0:6949:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782228861.682539:0:6949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228861.682650:0:6949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228861.682682:0:6949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1782228861.682725:0:6949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782228861.683232:0:6962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782228861.683237:0:6962:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782228861.684233:0:6949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782228861.684251:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782228861.684287:0:6949:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782228861.684306:0:6949:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e635e2 00000100:00080000:0.0:1782228861.684318:0:6949:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782228861.684324:0:6949:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98fe7d897000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782228861.684372:0:6949:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe446aed80 x1868802329422080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782228861.684407:0:6949:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1782228861.684474:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329422080:0@lo:8: 00000020:01000000:0.0:1782228861.684479:0:6949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782228861.684483:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228861.684485:0:6949:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782228861.684487:0:6949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782228861.684490:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228861.684491:0:6949:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782228861.684494:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782228861.684495:0:6949:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782228861.684515:0:6949:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6949:1868802329422208:0@lo:502: 00000100:00100000:2.0:1782228861.684541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228861.684553:0:6949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228861.684657:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422080 00000100:00100000:2.0:1782228861.684664:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422080 00000100:00100000:2.0:1782228861.684693:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782228861.684701:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1868802329422080:12345-0@lo:8: 00000100:00100000:0.0:1782228861.684712:0:6949:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898300 going to sleep for 11 seconds 00010000:00080000:2.0:1782228861.684723:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000100:00100000:0.0:1782228861.684728:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422208 00000100:00100000:0.0:1782228861.684731:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422208 00000020:00000080:2.0:1782228861.684746:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e635e9 00000100:00100000:0.0:1782228861.684757:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782228861.684762:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:6949:x1868802329422208:12345-0@lo:502: 00002000:00100000:2.0:1782228861.684772:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98fe7d892800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1782228861.684776:0:6598:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1782228861.684780:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782228861.684880:0:6598:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782228861.685017:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782228861.685039:0:6598:0:(import.c:65:import_set_state_nolock()) ffff98fe7d891800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782228861.685081:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1868802329422080:12345-0@lo:8: Request processed in 378us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.685081:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:6949:x1868802329422208:12345-0@lo:502: Request processed in 317us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228861.685088:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782228861.685088:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782228861.685110:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329422336:0@lo:400: 00000100:00100000:0.0:1782228861.685135:0:6949:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:6949:1868802329422208:0@lo:502: 00000100:00100000:2.0:1782228861.685136:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228861.685155:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:01000000:0.0:1782228861.685158:0:6949:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1782228861.685160:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329422464:0@lo:400: 00000020:00000080:0.0:1782228861.685166:0:6949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228861.685168:0:6949:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782228861.685171:0:6949:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1782228861.685179:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228861.685221:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422336 00000100:00100000:2.0:1782228861.685225:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422336 00000100:00100000:2.0:1782228861.685245:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422464 00000100:00100000:2.0:1782228861.685247:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422464 00000020:01000000:0.0:1782228861.685257:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:2.0:1782228861.685260:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782228861.685265:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329422336:12345-0@lo:400: 10000000:01000000:0.0:1782228861.685275:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782228861.685284:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228861.685295:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228861.685299:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329422336:12345-0@lo:400: Request processed in 34us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228861.685304:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1782228861.685305:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782228861.685307:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff98fe68ea3380 from 1 10000000:01000000:0.0:1782228861.685310:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1782228861.685314:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782228861.685319:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329422464:12345-0@lo:400: 00010000:00010000:0.0:1782228861.685333:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228861.685340:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329422464:12345-0@lo:400: Request processed in 21us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1782228861.685341:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228861.685345:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782228861.685375:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe50c8f800 x1868802329422464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228861.685386:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329422464:0@lo:400: 00010000:00080000:2.0:1782228861.685396:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe50c8ed80 x1868802329422336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228861.685404:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329422336:0@lo:400: 00010000:00080000:2.0:1782228861.685453:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe446aed80 x1868802329422080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782228871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228861.685461:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782228861.685467:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782228861.685475:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782228861.685480:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782228861.685491:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7d897000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782228861.685501:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782228861.685507:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329422080:0@lo:8: 00000004:00080000:2.0:1782228861.685527:0:6962:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:0.0:1782228861.685549:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228861.685562:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329422592:0@lo:101: 00000100:00100000:0.0:1782228861.685587:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228861.685602:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898300 going to sleep for 11 seconds 00000004:00080000:2.0:1782228861.685618:0:6962:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 174682187105ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782228861.685620:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422592 00000100:00100000:0.0:1782228861.685623:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422592 00000100:00100000:0.0:1782228861.685640:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782228861.685646:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329422592:12345-0@lo:101: 00010000:00010000:0.0:1782228861.685653:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228861.685670:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e635f0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228861.685690:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228861.685701:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228861.685709:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030c00, rc 0) 00000100:00100000:0.0:1782228861.685736:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329422592:12345-0@lo:101: Request processed in 90us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.685741:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782228861.685767:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329422592:0@lo:101: 00010000:00010000:0.0:1782228861.685778:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228861.685785:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228861.685819:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329422720:0@lo:501: 00000100:00100000:0.0:1782228861.685840:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228861.685851:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898300 going to sleep for 11 seconds 00000100:00100000:0.0:1782228861.685862:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422720 00000100:00100000:0.0:1782228861.685865:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422720 00000100:00100000:0.0:1782228861.685882:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782228861.685888:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329422720:12345-0@lo:501: 00000100:00100000:0.0:1782228861.686225:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329422720:12345-0@lo:501: Request processed in 336us (383us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782228861.686241:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782228861.686274:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329422720:0@lo:501: 10000000:01000000:0.0:1782228861.686293:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782228861.686299:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228861.686305:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782228861.727534:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:02000400:1.0:1782228861.728081:0:6967:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1782228861.762057:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329422848:0@lo:13: 00000100:00100000:0.0:1782228861.762134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782228861.762224:0:6963:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782228861.762259:0:6963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329422976:0@lo:7: 00000100:00100000:1.0:1782228861.762292:0:6963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.762310:0:6963:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b240 going to sleep for 11 seconds 00000100:00100000:0.0:1782228861.762660:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422848 00000100:00100000:0.0:1782228861.762667:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422848 00000100:00100000:0.0:1782228861.762827:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782228861.762837:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329422848:12345-0@lo:13: 00002000:00000024:0.0:1782228861.762868:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1782228861.762912:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329422848:12345-0@lo:13: Request processed in 78us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228861.762919:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782228861.762973:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e7a300 x1868802329422848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228861.762990:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329422848:0@lo:13: 00000100:00080000:1.0:1782228861.763144:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782228861.765024:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329422976 00000100:00100000:2.0:1782228861.765040:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329422976 00000100:00100000:2.0:1782228861.765129:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782228861.765139:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6963:x1868802329422976:12345-0@lo:7: 00002000:00080000:2.0:1782228861.774271:0:6600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1782228861.774282:0:6600:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782228861.774982:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6963:x1868802329422976:12345-0@lo:7: Request processed in 9838us (12680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228861.774992:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782228861.775099:0:6963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e78e00 x1868802329422976/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782228877 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228861.775115:0:6963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329422976:0@lo:7: 00000004:00080000:1.0:1782228861.775130:0:6963:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782228861.775172:0:6963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329423104:0@lo:5: 00000100:00100000:1.0:1782228861.775212:0:6963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228861.779279:0:6963:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b240 going to sleep for 11 seconds 00000100:00100000:2.0:1782228861.779969:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329423104 00000100:00100000:2.0:1782228861.779980:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329423104 00000100:00100000:2.0:1782228861.780045:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782228861.780056:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6963:x1868802329423104:12345-0@lo:5: 00002000:00080000:2.0:1782228861.780087:0:6599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782228861.780091:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1782228861.780544:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6963:x1868802329423104:12345-0@lo:5: Request processed in 489us (5330us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782228861.780553:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782228861.783530:0:6963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e78e00 x1868802329423104/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782228877 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228861.783553:0:6963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329423104:0@lo:5: 00000004:00080000:3.0:1782228861.783568:0:6963:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782228861.783611:0:6963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329423232:0@lo:700: 00000100:00100000:3.0:1782228861.783670:0:6963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228861.783727:0:6963:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1782228861.783795:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329423232 00000100:00100000:2.0:1782228861.783803:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329423232 00000100:00100000:2.0:1782228861.783845:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782228861.783855:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6963:x1868802329423232:12345-0@lo:700: 00000100:00100000:2.0:1782228861.783900:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6606:1868802329423360:0@lo:700: 00000100:00100000:2.0:1782228861.783949:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228861.784117:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44667840 going to sleep for 11 seconds 00000100:00100000:3.0:1782228861.785149:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329423360 00000100:00100000:3.0:1782228861.785156:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329423360 00000100:00100000:3.0:1782228861.785214:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782228861.785222:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6606:x1868802329423360:12345-0@lo:700: 40000000:02000000:3.0:1782228861.826321:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1782228861.831937:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6606:x1868802329423360:12345-0@lo:700: Request processed in 46708us (47980us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228861.831951:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782228861.832075:0:6606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe50c8ed80 x1868802329423360/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782228877 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228861.832092:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6606:1868802329423360:0@lo:700: 40000000:02000000:2.0:1782228861.832105:0:6606:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1782228861.898302:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1782228861.898319:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1782228861.898677:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6963:x1868802329423232:12345-0@lo:700: Request processed in 114819us (115001us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228861.898695:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782228861.898753:0:6963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe81999880 x1868802329423232/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782228877 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228861.898778:0:6963:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782228861.898796:0:6963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329423232:0@lo:700: 00000004:02000040:3.0:1782228861.940160:0:6963:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1782228861.953387:0:6963:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329423488:0@lo:5: 00000100:00100000:2.0:1782228861.953476:0:6963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228861.953522:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329423488 00000100:00100000:2.0:1782228861.953530:0:6963:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44667780 going to sleep for 11 seconds 00000100:00100000:3.0:1782228861.955104:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329423488 00000100:00100000:3.0:1782228861.955637:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782228861.955652:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6963:x1868802329423488:12345-0@lo:5: 00002000:00080000:2.0:1782228861.966518:0:6600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1782228861.966542:0:6600:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1782228861.976233:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6963:x1868802329423488:12345-0@lo:5: Request processed in 20577us (22748us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782228861.976247:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782228861.976309:0:6963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe50c8ed80 x1868802329423488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782228877 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228861.976328:0:6963:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6963:1868802329423488:0@lo:5: 00000004:00080000:2.0:1782228861.976342:0:6963:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1782228862.336262:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228863.356736:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228864.381287:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228865.403654:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782228866.287686:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1782228866.429902:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228867.195610:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329423616:0@lo:400: 00000100:00100000:1.0:1782228867.195623:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329424000:0@lo:400: 00000100:00100000:0.0:1782228867.195717:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329423744:0@lo:400: 00000100:00100000:1.0:1782228867.197011:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228867.197088:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782228867.197098:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329424128:0@lo:13: 00000100:00100000:1.0:1782228867.197137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228867.197203:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424128 00000100:00100000:3.0:1782228867.197213:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424128 00000100:00100000:3.0:1782228867.197272:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782228867.197282:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329424128:12345-0@lo:13: 00000100:00080000:1.0:1782228867.197446:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782228867.198020:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228867.198062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228867.198064:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228867.198115:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782228867.198126:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329423872:0@lo:400: 00000100:00100000:2.0:1782228867.198133:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329423616 00000100:00100000:2.0:1782228867.198139:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329423616 00000100:00100000:2.0:1782228867.198183:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782228867.198192:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3309:x1868802329423616:12345-0@lo:400: 00000100:00100000:3.0:1782228867.198195:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329424128:12345-0@lo:13: Request processed in 912us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228867.198205:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782228867.198234:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424000 00000100:00100000:3.0:1782228867.198238:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424000 00000100:00100000:2.0:1782228867.198243:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3309:x1868802329423616:12345-0@lo:400: Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228867.198251:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782228867.198273:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782228867.198285:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228867.198286:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329424000:12345-0@lo:400: 00000100:00100000:2.0:1782228867.198296:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329423744 00000100:00100000:2.0:1782228867.198301:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329423744 00000100:00100000:2.0:1782228867.198330:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329423872 00000100:00100000:2.0:1782228867.198334:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329423872 00000100:00100000:2.0:1782228867.198363:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782228867.198372:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329423744:12345-0@lo:400: 00000100:00100000:3.0:1782228867.199347:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329424000:12345-0@lo:400: Request processed in 1061us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228867.199357:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782228867.199367:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329423744:12345-0@lo:400: Request processed in 993us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228867.199377:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782228867.199402:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782228867.199411:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329423872:12345-0@lo:400: 00010000:00080000:3.0:1782228867.199420:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe81999880 x1868802329424128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228867.199461:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782228867.199469:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329423872:12345-0@lo:400: Request processed in 60us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228867.199478:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782228867.199497:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329424128:0@lo:13: 00010000:00080000:3.0:1782228867.199516:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e78e00 x1868802329424000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782228867.199518:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228867.199529:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329424000:0@lo:400: 00010000:00080000:3.0:1782228867.199661:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e78380 x1868802329423872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228867.199671:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329423872:0@lo:400: 00010000:00080000:3.0:1782228867.199685:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e79180 x1868802329423744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228867.199693:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329423744:0@lo:400: 00000100:00100000:2.0:1782228867.201605:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329423616:0@lo:400: 00010000:00010000:1.0:1782228867.453512:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228868.475767:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228869.499593:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228870.524230:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782228870.602420:0:7493:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782228870.602424:0:7493:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1782228870.602591:0:7493:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98fe7fe6d000 00000020:01000004:0.0:1782228870.602611:0:7493:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782228870.602624:0:7493:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1782228870.602637:0:7493:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98fe66024d40) 00000020:00000080:0.0:1782228870.602663:0:7493:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782228870.627104:0:7493:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1782228870.627369:0:7493:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782228870.654001:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782228870.664404:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782228870.664472:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782228870.664531:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782228870.664647:0:7493:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782228870.665179:0:7493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1782228870.665192:0:7493:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782228870.665202:0:7493:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e1c8a3488e63605 00000020:01000004:2.0:1782228870.665211:0:7493:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1782228870.665233:0:7493:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782228870.665236:0:7493:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782228870.665242:0:7493:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782228870.665263:0:7493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1782228870.665267:0:7493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782228870.688627:0:7493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782228870.688667:0:7493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.122@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1782228870.688671:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782228870.688673:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782228870.688675:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228870.688676:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782228870.688677:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228870.688678:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228870.688680:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782228870.688682:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782228870.688683:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782228870.688685:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228870.688686:0:7493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782228870.688690:0:7493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1782228870.688693:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782228870.688694:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782228870.688695:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228870.688696:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782228870.688697:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228870.688699:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228870.688700:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782228870.688705:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782228870.688705:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782228870.688706:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228870.688707:0:7493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782228870.688735:0:7493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782228870.688757:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329424256:0@lo:253: 00000100:00100000:3.0:1782228870.688867:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.688978:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4681d780 going to sleep for 11 seconds 00000100:00100000:0.0:1782228870.689040:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424256 00000100:00100000:0.0:1782228870.689049:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424256 00000100:00100000:0.0:1782228870.689144:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782228870.689154:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:7493:x1868802329424256:12345-0@lo:253: 20000000:01000000:0.0:1782228870.689194:0:5792:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782228870.689198:0:5792:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1782228870.689202:0:5792:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1782228870.689205:0:5792:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1782228870.690069:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782228870.690286:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1782228870.690300:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1782228870.690339:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1782228870.690349:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1782228870.690378:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1782228870.690449:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1782228870.690815:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1782228870.690849:0:5792:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.122@tcp 20000000:01000000:0.0:1782228870.690851:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.122@tcp (null) (null) (null) 00000040:00080000:0.0:1782228870.690888:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1782228870.690896:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782228870.690958:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1782228870.690967:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.122@tcp (null) (null) 00000040:00080000:0.0:1782228870.690998:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1782228870.691007:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782228870.691033:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1782228870.691081:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1782228870.691844:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1782228870.691860:0:5792:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.122@tcp 20000000:01000000:0.0:1782228870.691862:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.122@tcp (null) (null) (null) 00000040:00080000:0.0:1782228870.691892:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1782228870.691898:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782228870.691921:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1782228870.691927:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.122@tcp (null) (null) 00000040:00080000:0.0:1782228870.691950:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1782228870.691956:0:5792:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782228870.691990:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1782228870.692025:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1782228870.692039:0:5792:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1782228870.692042:0:5792:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1782228870.692049:0:5792:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782228870.692050:0:5792:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782228870.692052:0:5792:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782228870.692064:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782228870.692066:0:5792:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782228870.692095:0:5792:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782228870.692097:0:5792:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782228870.693242:0:7494:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1782228870.693314:0:7494:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1782228870.693345:0:7494:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1782228870.693645:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1782228870.693684:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1782228870.693732:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1782228870.693744:0:5792:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782228870.693747:0:5792:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782228870.694200:0:7495:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1782228870.694242:0:7495:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1782228870.694290:0:7495:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1782228870.694688:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1782228870.694752:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1782228870.694786:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1782228870.694797:0:5792:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782228870.694799:0:5792:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782228870.695383:0:7496:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1782228870.695674:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1782228870.695716:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1782228870.695776:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1782228870.695788:0:5792:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782228870.695790:0:5792:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782228870.696254:0:7497:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1782228870.696316:0:7497:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1782228870.696370:0:7497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1782228870.696650:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1782228870.696692:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1782228870.696746:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1782228870.696765:0:5792:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782228870.696783:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696801:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696810:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696817:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696836:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696844:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696852:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696898:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.696917:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 16 pid: 5792 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.696932:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424384:0@lo:104: 00000100:00100000:0.0:1782228870.697002:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782228870.697098:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697107:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 16 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.697116:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424512:0@lo:104: 00010000:00010000:0.0:1782228870.697142:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697150:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 16 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.697158:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424640:0@lo:104: 00010000:00010000:0.0:1782228870.697197:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697205:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 16 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.697213:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424768:0@lo:104: 00010000:00010000:0.0:1782228870.697248:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697256:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 16 pid: 5790 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.697265:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424896:0@lo:104: 00000100:00100000:0.0:1782228870.697281:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60300 going to sleep for 11 seconds 00000100:00100000:2.0:1782228870.697340:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782228870.697360:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.697425:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.697535:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228870.697588:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424384 00000100:00100000:0.0:1782228870.697596:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424384 00000100:00100000:0.0:1782228870.697631:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424512 00000100:00100000:0.0:1782228870.697635:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424512 00000100:00100000:0.0:1782228870.697646:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424640 00000100:00100000:0.0:1782228870.697649:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424640 00000100:00100000:0.0:1782228870.697663:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782228870.697672:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50833850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:5792:x1868802329424384:12345-0@lo:104: 00010000:00010000:0.0:1782228870.697684:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697757:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782228870.697763:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50833850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:5792:x1868802329424384:12345-0@lo:104: Request processed in 92us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.697771:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782228870.697810:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782228870.697816:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:5792:x1868802329424512:12345-0@lo:104: 00010000:00010000:0.0:1782228870.697833:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697866:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782228870.697877:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:5792:x1868802329424512:12345-0@lo:104: Request processed in 61us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.697883:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782228870.697896:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782228870.697901:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5792:x1868802329424640:12345-0@lo:104: 00010000:00010000:0.0:1782228870.697909:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697942:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782228870.697946:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5792:x1868802329424640:12345-0@lo:104: Request processed in 46us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.697953:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1782228870.697971:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782228870.697976:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697983:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031800 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228870.697987:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.697997:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228870.698004:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228870.698010:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228870.698038:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698055:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228870.698070:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698077:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e635f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635f7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698090:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782228870.698093:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698099:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82050400 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228870.698102:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698108:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228870.698115:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228870.698121:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228870.698134:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698141:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228870.698146:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698153:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82050400/0x8e1c8a3488e635c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635cd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698169:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228870.698172:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698178:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53378200 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228870.698181:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698188:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228870.698193:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228870.698198:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228870.698209:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698214:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228870.698229:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698236:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e635aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635b1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698245:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228870.698246:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228870.698248:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228870.698254:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228870.698280:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782228870.698293:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329425280:0@lo:103: 00000100:00100000:0.0:1782228870.698323:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228870.698360:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425280 00000100:00100000:0.0:1782228870.698364:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425280 00010000:00010000:0.0:1782228870.698382:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 17 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.698400:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782228870.698405:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3309:x1868802329425280:12345-0@lo:103: 00010000:00010000:0.0:1782228870.698414:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228870.698418:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 17 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698450:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 17 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.698465:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228870.698491:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3309:x1868802329425280:12345-0@lo:103: Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.698497:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782228870.698530:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329425280:0@lo:103: 00000100:00100000:1.0:1782228870.698626:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424384:0@lo:104: 00000100:00100000:1.0:1782228870.698635:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424512:0@lo:104: 00010000:00010000:1.0:1782228870.698642:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e635b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e635aa expref: 16 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228870.698651:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424640:0@lo:104: 00010000:00010000:3.0:1782228870.698707:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228870.698719:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329425024:0@lo:103: 00000100:00100000:3.0:1782228870.698746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.698777:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782228870.698783:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329425152:0@lo:103: 00000100:00100000:3.0:1782228870.698801:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.698838:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425024 00000100:00100000:3.0:1782228870.698842:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425024 00010000:00010000:3.0:1782228870.698857:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 16 pid: 5792 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.698873:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425152 00000100:00100000:3.0:1782228870.698876:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425152 00010000:00010000:3.0:1782228870.698887:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 17 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.698898:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782228870.698903:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3310:x1868802329425024:12345-0@lo:103: 00010000:00010000:3.0:1782228870.698909:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228870.698913:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 17 pid: 5792 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.698923:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 17 pid: 5792 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.698938:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e635f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e635f0 expref: 17 pid: 5792 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.698948:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228870.698974:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3310:x1868802329425024:12345-0@lo:103: Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.698981:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782228870.698995:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782228870.699002:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:3310:x1868802329425152:12345-0@lo:103: 00010000:00010000:3.0:1782228870.699009:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228870.699013:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.699023:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.699032:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e635cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e635c6 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.699041:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228870.699061:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3310:x1868802329425152:12345-0@lo:103: Request processed in 59us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.699066:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782228870.699091:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329425152:0@lo:103: 00000100:00100000:3.0:1782228870.699100:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329425024:0@lo:103: 00000100:00100000:2.0:1782228870.699339:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228870.699405:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424768 00000100:00100000:0.0:1782228870.699409:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424768 00000100:00100000:0.0:1782228870.699521:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329424896 00000100:00100000:0.0:1782228870.699526:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329424896 00000100:00100000:0.0:1782228870.699544:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782228870.699549:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:5792:x1868802329424768:12345-0@lo:104: 00010000:00010000:0.0:1782228870.699560:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699657:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782228870.699663:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:5792:x1868802329424768:12345-0@lo:104: Request processed in 114us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.699670:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782228870.699685:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782228870.699690:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5792:x1868802329424896:12345-0@lo:104: 00010000:00010000:0.0:1782228870.699698:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699727:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782228870.699731:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5792:x1868802329424896:12345-0@lo:104: Request processed in 42us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.699736:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1782228870.699749:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782228870.699754:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699760:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82051800 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228870.699763:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699771:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228870.699779:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228870.699784:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228870.699815:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699821:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228870.699844:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699852:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051800/0x8e1c8a3488e63580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63587 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699861:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228870.699864:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699869:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82051c00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228870.699872:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699878:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228870.699884:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228870.699889:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228870.699901:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699907:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228870.699915:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699931:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6355d expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.699941:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228870.699943:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228870.699944:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228870.699963:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329425408:0@lo:103: 00000100:00100000:0.0:1782228870.699992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.700051:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782228870.700060:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329425536:0@lo:103: 00000100:00100000:3.0:1782228870.700089:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782228870.700119:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228870.700126:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425408 00000100:00100000:3.0:1782228870.700129:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425408 00010000:00010000:3.0:1782228870.700143:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 14 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.700160:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425536 00000100:00100000:3.0:1782228870.700163:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425536 00010000:00010000:3.0:1782228870.700175:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 15 pid: 5790 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.700185:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782228870.700191:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:3309:x1868802329425408:12345-0@lo:103: 00010000:00010000:3.0:1782228870.700199:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228870.700203:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700213:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700223:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228870.700248:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:3309:x1868802329425408:12345-0@lo:103: Request processed in 57us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.700254:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782228870.700265:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782228870.700271:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3311:x1868802329425536:12345-0@lo:103: 00010000:00010000:3.0:1782228870.700277:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228870.700281:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 14 pid: 5790 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700295:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 14 pid: 5790 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700306:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700313:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700329:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700335:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700342:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700348:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700353:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782228870.700356:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700363:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700370:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.700391:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228870.700414:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3311:x1868802329425536:12345-0@lo:103: Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.700420:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782228870.700471:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329425536:0@lo:103: 00000100:00100000:3.0:1782228870.700493:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329425408:0@lo:103: 00010000:00010000:1.0:1782228870.700648:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b3600/0x8e1c8a3488e63587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63580 expref: 13 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228870.700659:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424768:0@lo:104: 00010000:00010000:1.0:1782228870.700668:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6355d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63556 expref: 12 pid: 5790 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228870.700675:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5792:1868802329424896:0@lo:104: 00010000:00010000:1.0:1782228870.700698:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.700707:0:5792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.700713:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.700729:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40030400/0x8e1c8a3488e6360c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782228870.700741:0:5792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782228870.752337:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:7493:x1868802329424256:12345-0@lo:253: Request processed in 63173us (63459us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.752355:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782228870.752467:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329424256:0@lo:253: 10000000:01000000:3.0:1782228870.752483:0:7493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782228870.752486:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782228870.752488:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782228870.752490:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782228870.752491:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1782228870.752492:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782228870.752493:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782228870.752495:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782228870.752497:0:7493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782228870.752498:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782228870.752500:0:7493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782228870.752519:0:7493:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fe7fe6d000 from lustre-OST0001 10000000:01000000:3.0:1782228870.752547:0:7493:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782228870.752550:0:7493:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782228870.752557:0:7493:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98fe68ea3380 local copy 10000000:01000000:3.0:1782228870.752560:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782228870.752595:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.752605:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.752615:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.752649:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329425664:0@lo:101: 00000100:00100000:3.0:1782228870.752686:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.752784:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe45cb0540 going to sleep for 11 seconds 00000100:00100000:2.0:1782228870.752891:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425664 00000100:00100000:2.0:1782228870.752898:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425664 00000100:00100000:2.0:1782228870.752974:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782228870.752983:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+11:7493:x1868802329425664:12345-0@lo:101: 00010000:00010000:2.0:1782228870.752997:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228870.753019:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e6361a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63613 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228870.753162:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e6361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63613 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228870.753173:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e6361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63613 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228870.753181:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b3a00, rc 0) 00000100:00100000:2.0:1782228870.753223:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:7493:x1868802329425664:12345-0@lo:101: Request processed in 241us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228870.753229:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782228870.753287:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329425664:0@lo:101: 00010000:00010000:3.0:1782228870.753300:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.753308:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.753411:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329425792:0@lo:501: 00000100:00100000:3.0:1782228870.753464:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.753620:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe45cb0540 going to sleep for 11 seconds 00000100:00100000:0.0:1782228870.753667:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425792 00000100:00100000:0.0:1782228870.753672:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425792 00000100:00100000:1.0:1782228870.753715:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782228870.753725:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:7493:x1868802329425792:12345-0@lo:501: 00000100:00100000:1.0:1782228870.753961:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:7493:x1868802329425792:12345-0@lo:501: Request processed in 237us (496us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782228870.753968:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782228870.754062:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329425792:0@lo:501: 10000000:01000000:3.0:1782228870.754076:0:7493:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782228870.754104:0:7493:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782228870.754110:0:7493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754119:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754126:0:7493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754188:0:7493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782228870.754219:0:7493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fe7fe6d000 10000000:01000000:3.0:1782228870.754224:0:7493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782228870.754229:0:7493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782228870.754232:0:7493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782228870.754236:0:7493:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782228870.754239:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782228870.754256:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754264:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754272:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.754285:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329425920:0@lo:101: 00000100:00100000:3.0:1782228870.754311:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.754329:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4681d780 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.754342:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329425920 00000100:00100000:3.0:1782228870.754346:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329425920 00000100:00100000:3.0:1782228870.754365:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782228870.754372:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:7493:x1868802329425920:12345-0@lo:101: 00010000:00010000:3.0:1782228870.754379:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228870.754388:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63621 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754405:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754414:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754450:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53379400, rc 0) 00000100:00100000:3.0:1782228870.754481:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329425920:12345-0@lo:101: Request processed in 110us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.754487:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782228870.754518:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329425920:0@lo:101: 00010000:00010000:3.0:1782228870.754529:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.754537:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.754592:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426048:0@lo:501: 00000100:00100000:3.0:1782228870.754614:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.754632:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4681d780 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.754644:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426048 00000100:00100000:3.0:1782228870.754647:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426048 00000100:00100000:3.0:1782228870.754663:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782228870.754669:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426048:12345-0@lo:501: 00000100:00100000:3.0:1782228870.754818:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426048:12345-0@lo:501: Request processed in 147us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.754837:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782228870.754869:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426048:0@lo:501: 00000100:00100000:3.0:1782228870.754892:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426176:0@lo:503: 00000100:00100000:3.0:1782228870.754927:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.754941:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe685f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.754959:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426176 00000100:00100000:3.0:1782228870.754963:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426176 00000100:00100000:3.0:1782228870.754981:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782228870.754987:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426176:12345-0@lo:503: 00000100:00100000:3.0:1782228870.755127:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426176:12345-0@lo:503: Request processed in 139us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.755133:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782228870.755169:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426176:0@lo:503: 00000040:00080000:3.0:1782228870.755459:0:7493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782228870.755513:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426304:0@lo:502: 00000100:00100000:3.0:1782228870.755549:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.755570:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe685f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.755583:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426304 00000100:00100000:3.0:1782228870.755587:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426304 00000100:00100000:3.0:1782228870.755605:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782228870.755611:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426304:12345-0@lo:502: 00000100:00100000:3.0:1782228870.755735:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426304:12345-0@lo:502: Request processed in 122us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.755742:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782228870.755779:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426304:0@lo:502: 00000040:00080000:3.0:1782228870.756028:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782228870.756076:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782228870.756114:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782228870.756174:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782228870.756217:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782228870.756256:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782228870.756280:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426432:0@lo:502: 00000100:00100000:3.0:1782228870.756322:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.756337:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.756352:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426432 00000100:00100000:3.0:1782228870.756356:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426432 00000100:00100000:3.0:1782228870.756375:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782228870.756381:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426432:12345-0@lo:502: 00000100:00100000:3.0:1782228870.756534:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426432:12345-0@lo:502: Request processed in 152us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.756541:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782228870.756581:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426432:0@lo:502: 00000040:00080000:3.0:1782228870.756669:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782228870.756680:0:7493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1782228870.756970:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782228870.756978:0:7499:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1782228870.756984:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228870.756986:0:7499:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782228870.756991:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782228870.757005:0:7499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98fe74e38000) 00000020:00000080:3.0:1782228870.757028:0:7499:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782228870.757033:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782228870.757104:0:7499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fe7fe6d000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782228870.757112:0:7499:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782228870.757118:0:7499:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e1c8a3488e63636 00010000:00010000:1.0:1782228870.758188:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782228870.758199:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.758209:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53379000 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782228870.758213:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.758223:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782228870.758231:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228870.758237:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782228870.758271:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.758277:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782228870.758326:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.758334:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53379000/0x8e1c8a3488e63613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8e1c8a3488e6361a expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.758352:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228870.758354:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228870.758356:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228870.758465:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782228870.758486:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329426560:0@lo:103: 00000100:00100000:0.0:1782228870.758549:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.758892:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426560 00000100:00100000:2.0:1782228870.758899:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426560 00000100:00100000:2.0:1782228870.758960:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782228870.758970:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:3310:x1868802329426560:12345-0@lo:103: 00010000:00010000:2.0:1782228870.758991:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782228870.759007:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e6361a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63613 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228870.759037:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782228870.759267:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:3310:x1868802329426560:12345-0@lo:103: Request processed in 298us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228870.759276:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782228870.759369:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329426560:0@lo:103: 00010000:00010000:3.0:1782228870.763208:0:7499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1782228870.763587:0:7499:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1782228870.769265:0:7499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782228870.769820:0:7499:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1782228870.776306:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782228870.777052:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1782228870.780280:0:7499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1782228870.780292:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782228870.780297:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228870.780298:0:7499:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1782228870.780301:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782228870.780304:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228870.780305:0:7499:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782228870.780306:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782228870.780307:0:7499:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782228870.780354:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782228870.780355:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228870.780356:0:7499:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782228870.780358:0:7499:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782228870.780618:0:7493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1782228870.780641:0:7493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782228870.780692:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.780704:0:7493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228870.780714:0:7493:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7fe6d000 from 1 10000000:01000000:0.0:1782228870.780717:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782228870.780767:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.780776:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.780788:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.780817:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426688:0@lo:101: 00000100:00100000:0.0:1782228870.780955:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228870.781018:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.781068:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426688 00000100:00100000:3.0:1782228870.781076:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426688 00000100:00100000:3.0:1782228870.781146:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782228870.781154:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:7493:x1868802329426688:12345-0@lo:101: 00010000:00010000:3.0:1782228870.781165:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228870.781176:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6363d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.781194:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.781201:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.781207:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53379000, rc 0) 00000100:00100000:3.0:1782228870.781254:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426688:12345-0@lo:101: Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.781261:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782228870.781304:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426688:0@lo:101: 00010000:00010000:1.0:1782228870.781319:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.781328:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228870.781530:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426816:0@lo:501: 00000100:00100000:1.0:1782228870.781561:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.781584:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426816 00000100:00100000:1.0:1782228870.781585:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50991900 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.781588:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426816 00000100:00100000:3.0:1782228870.781654:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782228870.781662:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426816:12345-0@lo:501: 00000100:00100000:3.0:1782228870.781962:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426816:12345-0@lo:501: Request processed in 299us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.781969:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782228870.781989:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426816:0@lo:501: 00000100:00100000:1.0:1782228870.782018:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426944:0@lo:503: 00000100:00100000:1.0:1782228870.782068:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228870.782084:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50991900 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.782090:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329426944 00000100:00100000:3.0:1782228870.782094:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329426944 00000100:00100000:3.0:1782228870.782124:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782228870.782131:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426944:12345-0@lo:503: 00000100:00100000:1.0:1782228870.782578:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329426944:0@lo:503: 00000100:00100000:3.0:1782228870.782585:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329426944:12345-0@lo:503: Request processed in 456us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.782592:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000040:00080000:1.0:1782228870.782854:0:7493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782228870.782916:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427072:0@lo:502: 00000100:00100000:1.0:1782228870.782952:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228870.782984:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50991900 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.782995:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427072 00000100:00100000:3.0:1782228870.782999:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427072 00000100:00100000:3.0:1782228870.783068:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782228870.783075:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329427072:12345-0@lo:502: 00000100:00100000:3.0:1782228870.783223:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329427072:12345-0@lo:502: Request processed in 148us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.783230:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782228870.783302:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427072:0@lo:502: 00000040:00080000:2.0:1782228870.783675:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782228870.783754:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782228870.783782:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427200:0@lo:502: 00000100:00100000:2.0:1782228870.783849:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.783890:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ec86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.784256:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427200 00000100:00100000:3.0:1782228870.784262:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427200 00000100:00100000:3.0:1782228870.784301:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782228870.784311:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329427200:12345-0@lo:502: 00000100:00100000:3.0:1782228870.784532:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329427200:12345-0@lo:502: Request processed in 222us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.784549:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782228870.785300:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427200:0@lo:502: 00000040:00080000:2.0:1782228870.786194:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782228870.786216:0:7493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782228870.786931:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228870.786940:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228870.786942:0:7503:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782228870.786948:0:7503:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe7fe6d000 00000020:00000080:2.0:1782228870.786950:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782228870.786966:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228870.786969:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228870.786970:0:7503:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782228870.786973:0:7503:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782228870.787229:0:7493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782228870.787248:0:7493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782228870.788063:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.788077:0:7493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228870.788147:0:7493:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782228870.788150:0:7493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fe7fe6d000 10000000:01000000:3.0:1782228870.788153:0:7493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fe7fe6d000 10000000:01000000:3.0:1782228870.788157:0:7493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782228870.788163:0:7493:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe7fe6d000 from 1 10000000:01000000:3.0:1782228870.788166:0:7493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782228870.788200:0:7493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.788209:0:7493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.788220:0:7493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.788242:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427328:0@lo:101: 00000100:00100000:3.0:1782228870.788313:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.788355:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9180 going to sleep for 11 seconds 00000100:00100000:1.0:1782228870.788944:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427328 00000100:00100000:1.0:1782228870.788951:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427328 00000100:00100000:1.0:1782228870.789003:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782228870.789012:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329427328:12345-0@lo:101: 00010000:00010000:1.0:1782228870.789027:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228870.789039:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6364b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.789071:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.789082:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228870.789091:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051600, rc 0) 00000100:00100000:1.0:1782228870.789139:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427328:12345-0@lo:101: Request processed in 128us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228870.789146:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782228870.789253:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427328:0@lo:101: 00010000:00010000:3.0:1782228870.789268:0:7493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.789290:0:7493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.789388:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427456:0@lo:501: 00000100:00100000:3.0:1782228870.789415:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228870.789481:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9180 going to sleep for 11 seconds 00000100:00100000:0.0:1782228870.789546:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427456 00000100:00100000:0.0:1782228870.789551:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427456 00000100:00100000:0.0:1782228870.789582:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782228870.789589:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427456:12345-0@lo:501: 00000100:00100000:0.0:1782228870.789818:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427456:12345-0@lo:501: Request processed in 228us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.789892:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782228870.790077:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427456:0@lo:501: 00000100:00100000:2.0:1782228870.790218:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427584:0@lo:503: 00000100:00100000:2.0:1782228870.790259:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.790285:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ec8180 going to sleep for 11 seconds 00000100:00100000:1.0:1782228870.790335:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427584 00000100:00100000:1.0:1782228870.790340:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427584 00000100:00100000:1.0:1782228870.790369:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782228870.790376:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427584:12345-0@lo:503: 00000100:00100000:1.0:1782228870.790556:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427584:12345-0@lo:503: Request processed in 179us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228870.790564:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782228870.790671:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427584:0@lo:503: 00000040:00080000:2.0:1782228870.791299:0:7493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782228870.791354:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427712:0@lo:502: 00000100:00100000:2.0:1782228870.791391:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.791424:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ec8180 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.791479:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427712 00000100:00100000:3.0:1782228870.791484:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427712 00000100:00100000:3.0:1782228870.791506:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782228870.791511:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427712:12345-0@lo:502: 00000100:00100000:3.0:1782228870.791640:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427712:12345-0@lo:502: Request processed in 127us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.791647:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782228870.791665:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427712:0@lo:502: 00000040:00080000:2.0:1782228870.791991:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1782228870.792031:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782228870.792057:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782228870.792120:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782228870.792155:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782228870.792201:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782228870.792236:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782228870.792264:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782228870.792307:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782228870.792340:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782228870.792377:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782228870.792422:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782228870.792479:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782228870.792534:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782228870.792591:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782228870.792632:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782228870.792661:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782228870.792859:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782228870.792895:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782228870.792926:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782228870.792979:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782228870.793013:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782228870.793043:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782228870.793153:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782228870.793191:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782228870.793223:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782228870.793267:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782228870.793299:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1782228870.793330:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1782228870.793396:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1782228870.793473:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1782228870.793512:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1782228870.793543:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1782228870.793591:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1782228870.793625:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1782228870.793871:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1782228870.793918:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1782228870.793965:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427840:0@lo:502: 00000100:00100000:2.0:1782228870.794031:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.794136:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ec8180 going to sleep for 11 seconds 00000100:00100000:0.0:1782228870.794143:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427840 00000100:00100000:0.0:1782228870.794150:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427840 00000100:00100000:0.0:1782228870.794195:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782228870.794204:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427840:12345-0@lo:502: 00000100:00100000:0.0:1782228870.794420:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329427840:12345-0@lo:502: Request processed in 216us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.794462:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782228870.794855:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329427840:0@lo:502: 00000040:00080000:2.0:1782228870.794934:0:7493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1782228870.794945:0:7493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1782228870.796246:0:7504:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782228870.796259:0:7504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98fe77bc4d40) 00000020:00000080:1.0:1782228870.796278:0:7504:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1782228870.796871:0:7504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fe7fe6d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782228870.796876:0:7504:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fe7fe6d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782228870.796879:0:7504:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe7fe6d000 3 00010000:00080000:1.0:1782228870.796906:0:7504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe7fe6a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.122@tcp at head 00010000:00010000:1.0:1782228870.802137:0:7504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1782228870.802241:0:7504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782228870.802279:0:7504:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782228870.802292:0:7504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8e1c8a3488e63660 00000100:00080000:1.0:1782228870.802303:0:7504:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782228870.802309:0:7504:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98fe7fe6a800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:1.0:1782228870.802345:0:7504:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe74e79f80 x1868802329427968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782228870.802369:0:7504:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782228870.802403:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1868802329427968:0@lo:38: 00000100:00100000:2.0:1782228870.802486:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.802563:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329427968 00000100:00100000:2.0:1782228870.802569:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329427968 00000100:00100000:2.0:1782228870.802601:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782228870.802607:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1868802329427968:12345-0@lo:38: 00010000:00080000:2.0:1782228870.802627:0:5797:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1782228870.802660:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8e1c8a3488e63667 00000004:00100000:2.0:1782228870.802673:0:5797:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782228870.802698:0:5797:0:(import.c:65:import_set_state_nolock()) ffff98fe77b00800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782228870.802746:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868802329427968:12345-0@lo:38: Request processed in 136us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228870.802753:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782228870.802788:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e79f80 x1868802329427968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782228880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228870.802799:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782228870.802806:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1782228870.802814:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782228870.802818:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782228870.802841:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782228870.802850:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1868802329427968:0@lo:38: 00000040:00080000:1.0:1782228870.803104:0:7504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1782228870.803191:0:7493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1782228870.803221:0:7493:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782228870.803240:0:7493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228870.803251:0:7493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782228870.803300:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782228870.803302:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782228870.803304:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782228870.803305:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782228870.803307:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782228870.803308:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782228870.803309:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782228870.803311:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782228870.803312:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782228870.803314:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782228870.803316:0:7493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782228870.803319:0:7493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1782228870.803322:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782228870.803323:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782228870.803324:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782228870.803326:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782228870.803327:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782228870.803328:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782228870.803329:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782228870.803330:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782228870.803331:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782228870.803332:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782228870.803333:0:7493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782228870.803349:0:7493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782228870.803362:0:7493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329428096:0@lo:253: 00000100:00100000:2.0:1782228870.803411:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.803466:0:7493:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ec8900 going to sleep for 11 seconds 00000100:00100000:1.0:1782228870.803500:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329428224:0@lo:400: 00000100:00100000:0.0:1782228870.803514:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329428352:0@lo:400: 00000100:00100000:1.0:1782228870.803537:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228870.803550:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329428480:0@lo:400: 00000100:00100000:0.0:1782228870.803578:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228870.803604:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.803733:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428224 00000100:00100000:2.0:1782228870.803737:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428224 00000100:00100000:2.0:1782228870.803762:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428352 00000100:00100000:2.0:1782228870.803764:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428352 00000100:00100000:2.0:1782228870.803787:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782228870.803794:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329428224:12345-0@lo:400: 00000100:00100000:2.0:1782228870.803858:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329428224:12345-0@lo:400: Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228870.803902:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782228870.803906:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782228870.803911:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329428352:12345-0@lo:400: 00000100:00100000:2.0:1782228870.803937:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428480 00000100:00100000:2.0:1782228870.803945:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428480 00000100:00100000:1.0:1782228870.803953:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329428352:12345-0@lo:400: Request processed in 45us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228870.803959:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1782228870.803974:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe446adf80 x1868802329428352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228870.803977:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782228870.803988:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329428480:12345-0@lo:400: 00000100:00100000:0.0:1782228870.803993:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329428352:0@lo:400: 00000100:00100000:2.0:1782228870.804038:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329428480:12345-0@lo:400: Request processed in 52us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228870.804044:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782228870.804065:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782228870.804069:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782228870.804092:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe446ac000 x1868802329428224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228870.804101:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329428224:0@lo:400: 00000100:00100000:2.0:1782228870.804151:0:7506:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1868802329428608:0@lo:901: 00000100:00100000:2.0:1782228870.804195:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228870.804211:0:7506:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ec8540 going to sleep for 11 seconds 00010000:00080000:1.0:1782228870.804236:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe446aea00 x1868802329428480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228870.804247:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329428480:0@lo:400: 00000100:00100000:3.0:1782228870.805412:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428096 00000100:00100000:3.0:1782228870.805420:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428096 00000100:00100000:0.0:1782228870.805486:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428608 00000100:00100000:0.0:1782228870.805490:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428608 00000100:00080000:1.0:1782228870.805536:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228870.805539:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782228870.805548:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1868802329428608:12345-0@lo:901: 00000100:00100000:0.0:1782228870.805952:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1868802329428608:12345-0@lo:901: Request processed in 405us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.805958:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782228870.806032:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782228870.806037:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7493:x1868802329428096:12345-0@lo:253: 20000000:01000000:3.0:1782228870.806054:0:5792:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782228870.806069:0:5792:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1782228870.806201:0:7506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe50c8d500 x1868802329428608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782228886 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228870.806229:0:7506:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1868802329428608:0@lo:901: 20000000:01000000:1.0:1782228870.827817:0:5792:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782228870.827875:0:5792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782228870.828020:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782228870.828080:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782228870.828100:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.828120:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.828129:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.828170:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.828185:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 14 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.828219:0:5812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1868802329428736:0@lo:104: 00000100:00100000:0.0:1782228870.828284:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228870.828867:0:5812:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60300 going to sleep for 11 seconds 00000100:00100000:3.0:1782228870.829261:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428736 00000100:00100000:3.0:1782228870.829269:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428736 00000100:00100000:3.0:1782228870.829330:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782228870.829339:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5812:x1868802329428736:12345-0@lo:104: 00010000:00010000:3.0:1782228870.829356:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.829448:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782228870.829465:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:5812:x1868802329428736:12345-0@lo:104: Request processed in 127us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.829474:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782228870.829597:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228870.829604:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829612:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe605b2a00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228870.829616:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829626:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228870.829633:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228870.829641:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228870.829673:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829680:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228870.829710:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829717:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe605b2a00/0x8e1c8a3488e635b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e635bf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228870.829733:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782228870.829734:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228870.829742:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228870.829743:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228870.829746:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329428864:0@lo:103: 00000100:00100000:0.0:1782228870.829787:0:5812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1868802329428736:0@lo:104: 00000100:00100000:3.0:1782228870.829791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782228870.829807:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.829841:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428864 00000100:00100000:0.0:1782228870.829846:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428864 00010000:00010000:0.0:1782228870.829865:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.829890:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782228870.829897:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:3310:x1868802329428864:12345-0@lo:103: 00010000:00010000:0.0:1782228870.829909:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228870.829914:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829928:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829943:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e635bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e635b8 expref: 15 pid: 5791 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829957:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829966:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782228870.829978:0:5783:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003499624s 00010000:00010000:0.0:1782228870.829983:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.829998:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.830004:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.830010:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.830015:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782228870.830018:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.830031:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.830051:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228870.830059:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228870.830088:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3310:x1868802329428864:12345-0@lo:103: Request processed in 192us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228870.830095:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1782228870.830113:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.830120:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228870.830126:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e6366e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228870.830136:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329428864:0@lo:103: 00000100:00100000:3.0:1782228870.833730:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:7493:x1868802329428096:12345-0@lo:253: Request processed in 27683us (30308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228870.833747:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782228870.833778:0:7493:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7493:1868802329428096:0@lo:253: 10000000:01000000:2.0:1782228870.833811:0:7493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782228870.833814:0:7493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782228870.833816:0:7493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782228870.833817:0:7493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782228870.833819:0:7493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782228870.833820:0:7493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782228870.833990:0:7493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782228870.833992:0:7493:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782228870.833993:0:7493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782228870.833994:0:7493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782228870.833995:0:7493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782228870.833997:0:7493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782228870.834013:0:7493:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782228870.839224:0:7493:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782228870.840026:0:7493:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782228870.840250:0:7493:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782228870.840446:0:7493:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782228870.840615:0:7493:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782228870.840889:0:7493:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782228870.841873:0:7493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782228870.993632:0:7493:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782228870.993639:0:7493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782228870.993672:0:7493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782228870.993732:0:7493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782228870.993753:0:7493:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782228870.993785:0:7493:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 10000000:01000000:1.0:1782228871.419564:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782228871.419576:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe7b8d6000 from 30 10000000:01000000:1.0:1782228871.419582:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782228871.419642:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.419654:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.419665:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228871.419693:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329428992:0@lo:101: 00000100:00100000:1.0:1782228871.420362:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.420497:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b000 going to sleep for 11 seconds 00000100:00100000:3.0:1782228871.421270:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329428992 00000100:00100000:3.0:1782228871.421282:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329428992 00000100:00100000:3.0:1782228871.422959:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782228871.422979:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329428992:12345-0@lo:101: 00010000:00010000:3.0:1782228871.422997:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228871.423016:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63675 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.423069:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.423081:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.423090:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53378c00, rc 0) 00000100:00100000:3.0:1782228871.423172:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329428992:12345-0@lo:101: Request processed in 202us (2814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228871.423179:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782228871.423265:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329428992:0@lo:101: 00010000:00010000:2.0:1782228871.423286:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.423296:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228871.423374:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429120:0@lo:501: 00000100:00100000:2.0:1782228871.423412:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228871.423480:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.423521:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329429120 00000100:00100000:2.0:1782228871.423534:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329429120 00000100:00100000:2.0:1782228871.423572:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782228871.423579:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329429120:12345-0@lo:501: 00000100:00100000:2.0:1782228871.424385:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329429120:12345-0@lo:501: Request processed in 803us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.424395:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782228871.424534:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429120:0@lo:501: 00000100:00100000:1.0:1782228871.424572:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429248:0@lo:503: 00000100:00100000:1.0:1782228871.424615:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.424683:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b300 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.424725:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329429248 00000100:00100000:2.0:1782228871.424731:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329429248 00000100:00100000:2.0:1782228871.424873:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782228871.424882:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329429248:12345-0@lo:503: 00000100:00100000:2.0:1782228871.425209:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329429248:12345-0@lo:503: Request processed in 327us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.425216:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782228871.425571:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429248:0@lo:503: 00000100:00100000:0.0:1782228871.435580:0:7527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7527:1868802329429376:0@lo:502: 00000100:00100000:0.0:1782228871.435773:0:7527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228871.435849:0:7527:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.436199:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329429376 00000100:00100000:2.0:1782228871.436207:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329429376 00000100:00100000:2.0:1782228871.436267:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782228871.436278:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7527:x1868802329429376:12345-0@lo:502: 00000100:00100000:2.0:1782228871.437149:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7527:x1868802329429376:12345-0@lo:502: Request processed in 870us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.437159:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782228871.437287:0:7527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7527:1868802329429376:0@lo:502: 00000100:00100000:0.0:1782228871.437362:0:7527:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7527:1868802329429504:0@lo:502: 00000100:00100000:0.0:1782228871.437408:0:7527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228871.437510:0:7527:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.437596:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329429504 00000100:00100000:2.0:1782228871.437602:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329429504 00000100:00100000:2.0:1782228871.437674:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782228871.437682:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7527:x1868802329429504:12345-0@lo:502: 00000100:00100000:2.0:1782228871.437919:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:7527:x1868802329429504:12345-0@lo:502: Request processed in 237us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.437936:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782228871.438132:0:7527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7527:1868802329429504:0@lo:502: 00000040:00080000:0.0:1782228871.438154:0:7527:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782228871.438373:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782228871.438402:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782228871.438414:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.438425:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228871.438580:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782228871.438582:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1782228871.438585:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782228871.438611:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.438619:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.438626:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228871.438641:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429632:0@lo:101: 00000100:00100000:1.0:1782228871.438679:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.438755:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.438911:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329429632 00000100:00100000:2.0:1782228871.438918:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329429632 00000100:00100000:2.0:1782228871.438957:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782228871.438964:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329429632:12345-0@lo:101: 00010000:00010000:2.0:1782228871.438975:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228871.438989:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63683 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.439009:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.439020:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.439028:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b2600, rc 0) 00000100:00100000:2.0:1782228871.439273:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329429632:12345-0@lo:101: Request processed in 308us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.439280:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782228871.439926:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429632:0@lo:101: 00010000:00010000:3.0:1782228871.439945:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.439956:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228871.440025:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429760:0@lo:501: 00000100:00100000:3.0:1782228871.440064:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.440102:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9480 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.440226:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329429760 00000100:00100000:2.0:1782228871.440231:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329429760 00000100:00100000:2.0:1782228871.440340:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782228871.440404:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329429760:12345-0@lo:501: 00000100:00100000:2.0:1782228871.440970:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329429760:12345-0@lo:501: Request processed in 621us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.440977:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782228871.441096:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429760:0@lo:501: 00000100:00100000:3.0:1782228871.441130:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429888:0@lo:503: 00000100:00100000:3.0:1782228871.441171:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.441202:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9480 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.441259:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329429888 00000100:00100000:1.0:1782228871.441274:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329429888 00000100:00100000:1.0:1782228871.441312:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782228871.441320:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329429888:12345-0@lo:503: 00000100:00100000:1.0:1782228871.441839:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329429888:12345-0@lo:503: Request processed in 518us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.441846:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782228871.442685:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329429888:0@lo:503: 00000100:00100000:3.0:1782228871.443724:0:7528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7528:1868802329430016:0@lo:502: 00000100:00100000:3.0:1782228871.443882:0:7528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.443967:0:7528:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.445191:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430016 00000100:00100000:1.0:1782228871.445202:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430016 00000100:00100000:1.0:1782228871.445368:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782228871.445388:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:7528:x1868802329430016:12345-0@lo:502: 00000100:00100000:1.0:1782228871.445718:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:7528:x1868802329430016:12345-0@lo:502: Request processed in 339us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.445861:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782228871.445974:0:7528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7528:1868802329430016:0@lo:502: 00000020:01000000:3.0:1782228871.446023:0:7528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782228871.446034:0:7528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228871.446038:0:7528:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782228871.446044:0:7528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782228871.446046:0:7528:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782228871.446070:0:7528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7528:1868802329430144:0@lo:502: 00000100:00100000:3.0:1782228871.446115:0:7528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.446985:0:7528:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.447228:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430144 00000100:00100000:2.0:1782228871.447416:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430144 00000100:00100000:2.0:1782228871.447483:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782228871.447685:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:7528:x1868802329430144:12345-0@lo:502: 00000100:00100000:2.0:1782228871.448110:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:7528:x1868802329430144:12345-0@lo:502: Request processed in 618us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.448116:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782228871.448194:0:7528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7528:1868802329430144:0@lo:502: 00000020:01000000:3.0:1782228871.448226:0:7528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782228871.448337:0:7528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228871.448340:0:7528:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782228871.448345:0:7528:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1782228871.449649:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1782228871.449672:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782228871.449683:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.449695:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228871.449706:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782228871.449709:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe50300000 from 30 10000000:01000000:1.0:1782228871.449711:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782228871.449801:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.449819:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.449831:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228871.449854:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430272:0@lo:101: 00000100:00100000:1.0:1782228871.449906:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.449998:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b300 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.450108:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430272 00000100:00100000:2.0:1782228871.450116:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430272 00000100:00100000:2.0:1782228871.450188:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782228871.450196:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329430272:12345-0@lo:101: 00010000:00010000:2.0:1782228871.450208:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228871.450220:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63691 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.450243:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.450251:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.450259:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b3400, rc 0) 00000100:00100000:2.0:1782228871.450882:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329430272:12345-0@lo:101: Request processed in 684us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.450890:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782228871.451092:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430272:0@lo:101: 00010000:00010000:2.0:1782228871.451111:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228871.451120:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228871.451198:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430400:0@lo:501: 00000100:00100000:2.0:1782228871.451229:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228871.451375:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782228871.451653:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430400 00000100:00100000:3.0:1782228871.451660:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430400 00000100:00100000:3.0:1782228871.451837:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782228871.451846:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329430400:12345-0@lo:501: 00000100:00100000:3.0:1782228871.452128:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329430400:12345-0@lo:501: Request processed in 282us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228871.452135:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782228871.452261:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430400:0@lo:501: 00000100:00100000:2.0:1782228871.452306:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430528:0@lo:503: 00000100:00100000:2.0:1782228871.452344:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228871.452748:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.452849:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430528 00000100:00100000:1.0:1782228871.452856:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430528 00000100:00100000:1.0:1782228871.452886:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782228871.452894:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329430528:12345-0@lo:503: 00000100:00100000:1.0:1782228871.453139:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329430528:12345-0@lo:503: Request processed in 246us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.453155:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782228871.454257:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430528:0@lo:503: 00000100:00100000:3.0:1782228871.457644:0:7529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7529:1868802329430656:0@lo:502: 00000100:00100000:3.0:1782228871.457886:0:7529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.457928:0:7529:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.458066:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430656 00000100:00100000:1.0:1782228871.458074:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430656 00000100:00100000:1.0:1782228871.458123:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782228871.458133:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:7529:x1868802329430656:12345-0@lo:502: 00000100:00100000:1.0:1782228871.458413:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:7529:x1868802329430656:12345-0@lo:502: Request processed in 281us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.458422:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782228871.458470:0:7529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7529:1868802329430656:0@lo:502: 00000100:00100000:3.0:1782228871.458534:0:7529:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7529:1868802329430784:0@lo:502: 00000100:00100000:3.0:1782228871.458577:0:7529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.458603:0:7529:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.458925:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430784 00000100:00100000:2.0:1782228871.458931:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430784 00000100:00100000:2.0:1782228871.459014:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782228871.459022:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:7529:x1868802329430784:12345-0@lo:502: 00000100:00100000:2.0:1782228871.459200:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:7529:x1868802329430784:12345-0@lo:502: Request processed in 178us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.459207:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782228871.459281:0:7529:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7529:1868802329430784:0@lo:502: 00000040:00080000:1.0:1782228871.459304:0:7529:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1782228871.463493:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1782228871.463526:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782228871.463537:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.463549:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228871.463559:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782228871.463562:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fe50300000 from 5 10000000:01000000:3.0:1782228871.463564:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782228871.463603:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.463611:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.463622:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228871.463646:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430912:0@lo:101: 00000100:00100000:3.0:1782228871.463716:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.463759:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9480 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.463839:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329430912 00000100:00100000:1.0:1782228871.463846:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329430912 00000100:00100000:1.0:1782228871.463897:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782228871.463907:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329430912:12345-0@lo:101: 00010000:00010000:1.0:1782228871.463921:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228871.463932:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82051800/0x8e1c8a3488e636a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6369f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.463955:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82051800/0x8e1c8a3488e636a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6369f expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.463965:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82051800/0x8e1c8a3488e636a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6369f expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.463973:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051800, rc 0) 00000100:00100000:1.0:1782228871.464012:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329430912:12345-0@lo:101: Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.464029:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782228871.464161:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329430912:0@lo:101: 00010000:00010000:3.0:1782228871.464176:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.464191:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228871.464238:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431040:0@lo:256: 00000100:00100000:3.0:1782228871.464269:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.464290:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9480 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.464333:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431040 00000100:00100000:1.0:1782228871.464337:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431040 00000100:00100000:1.0:1782228871.464366:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782228871.464373:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329431040:12345-0@lo:256: 20000000:01000000:1.0:1782228871.464388:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782228871.464402:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782228871.464406:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1782228871.464501:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329431040:12345-0@lo:256: Request processed in 128us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.464508:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782228871.464577:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431040:0@lo:256: 10000000:01000000:3.0:1782228871.464616:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782228871.464622:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.464629:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228871.464637:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782228871.464639:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1782228871.464641:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782228871.464657:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.464665:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.464673:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228871.464684:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431168:0@lo:101: 00000100:00100000:3.0:1782228871.464714:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.464733:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9480 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.464772:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431168 00000100:00100000:1.0:1782228871.464776:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431168 00000100:00100000:1.0:1782228871.464805:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782228871.465000:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329431168:12345-0@lo:101: 00010000:00010000:1.0:1782228871.465008:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228871.465019:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e636ad expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.465036:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.465046:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228871.465144:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051000, rc 0) 00000100:00100000:1.0:1782228871.467164:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329431168:12345-0@lo:101: Request processed in 2345us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.467187:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782228871.467788:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431168:0@lo:101: 00010000:00010000:3.0:1782228871.467824:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.467837:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228871.467908:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431296:0@lo:501: 00000100:00100000:3.0:1782228871.467954:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.468028:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9480 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.468106:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431296 00000100:00100000:2.0:1782228871.468113:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431296 00000100:00100000:2.0:1782228871.468250:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782228871.468261:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329431296:12345-0@lo:501: 00000100:00100000:2.0:1782228871.468574:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329431296:12345-0@lo:501: Request processed in 314us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.468581:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782228871.468654:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431296:0@lo:501: 00000100:00100000:3.0:1782228871.468683:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431424:0@lo:503: 00000100:00100000:3.0:1782228871.468722:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.468925:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9480 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.471236:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431424 00000100:00100000:1.0:1782228871.471249:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431424 00000100:00100000:1.0:1782228871.471308:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782228871.471317:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329431424:12345-0@lo:503: 00000100:00100000:1.0:1782228871.471740:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329431424:12345-0@lo:503: Request processed in 423us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.471748:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782228871.471874:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329431424:0@lo:503: 00000100:00100000:2.0:1782228871.473237:0:7530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7530:1868802329431552:0@lo:502: 00000100:00100000:2.0:1782228871.473321:0:7530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228871.473368:0:7530:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f430c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.473417:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431552 00000100:00100000:1.0:1782228871.473423:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431552 00000100:00100000:1.0:1782228871.473480:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782228871.473489:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:7530:x1868802329431552:12345-0@lo:502: 00000100:00100000:1.0:1782228871.473836:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:7530:x1868802329431552:12345-0@lo:502: Request processed in 346us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.473845:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782228871.473948:0:7530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7530:1868802329431552:0@lo:502: 00000020:01000000:2.0:1782228871.473976:0:7530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782228871.473984:0:7530:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782228871.473991:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228871.473993:0:7530:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782228871.474002:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782228871.474006:0:7530:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.122@tcp to nid 0x20000c0a8cc7a (192.168.204.122@tcp) 00000020:01000000:2.0:1782228871.474028:0:7530:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782228871.474032:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782228871.474047:0:7530:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98fe7fff8000) 00000020:00000080:2.0:1782228871.474070:0:7530:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1782228871.474075:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782228871.474143:0:7530:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782228871.474149:0:7530:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782228871.474168:0:7530:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e636c2 00010000:00080000:2.0:1782228871.474197:0:7530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe77a81800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.122@tcp at head 00010000:00010000:2.0:1782228871.474720:0:7530:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1782228871.475269:0:7530:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1782228871.475283:0:7530:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782228871.478082:0:7530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228871.478343:0:7530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782228871.478395:0:7530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1782228871.481375:0:7530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1782228871.481887:0:7531:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782228871.481892:0:7531:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782228871.482716:0:7530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782228871.482727:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782228871.482760:0:7530:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782228871.482784:0:7530:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e636c9 00000100:00080000:2.0:1782228871.482797:0:7530:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782228871.482822:0:7530:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98fe77a81800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:2.0:1782228871.482861:0:7530:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe50c8d880 x1868802329431680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782228871.482889:0:7530:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1782228871.482941:0:7530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228871.482945:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228871.482947:0:7530:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782228871.482950:0:7530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228871.482953:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228871.482955:0:7530:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782228871.482957:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782228871.482959:0:7530:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782228871.482986:0:7530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7530:1868802329431808:0@lo:502: 00000100:00100000:2.0:1782228871.483070:0:7530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228871.483105:0:7530:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe685f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1782228871.483196:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329431680:0@lo:8: 00000100:00100000:3.0:1782228871.483232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.483475:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329432064:0@lo:400: 00000100:00100000:1.0:1782228871.483511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.483535:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782228871.483540:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329431936:0@lo:400: 00000100:00100000:1.0:1782228871.483558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.483580:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329432192:0@lo:400: 00000100:00100000:1.0:1782228871.483601:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.483620:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782228871.483624:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329432320:0@lo:400: 00000100:00100000:1.0:1782228871.483644:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228871.483675:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432064 00000100:00100000:1.0:1782228871.483688:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432064 00000100:00100000:1.0:1782228871.483721:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431936 00000100:00100000:1.0:1782228871.483724:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431936 00000100:00100000:1.0:1782228871.483735:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432320 00000100:00100000:1.0:1782228871.483737:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432320 00000100:00100000:1.0:1782228871.483751:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782228871.483759:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329432064:12345-0@lo:400: 00000100:00100000:1.0:1782228871.483825:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329432064:12345-0@lo:400: Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.483832:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782228871.483849:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782228871.483855:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329431936:12345-0@lo:400: 00000100:00100000:1.0:1782228871.483880:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329431936:12345-0@lo:400: Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.483885:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782228871.483894:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782228871.483900:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329432320:12345-0@lo:400: 00000100:00100000:1.0:1782228871.483926:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329432320:12345-0@lo:400: Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.483932:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782228871.483954:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431680 00000100:00100000:1.0:1782228871.483957:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431680 00000100:00100000:1.0:1782228871.483973:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432192 00000100:00100000:1.0:1782228871.483975:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432192 00000100:00100000:1.0:1782228871.483992:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782228871.483997:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329432192:12345-0@lo:400: 00000100:00100000:1.0:1782228871.484024:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329432192:12345-0@lo:400: Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.484040:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782228871.484052:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782228871.484056:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1868802329431680:12345-0@lo:8: 00010000:00080000:1.0:1782228871.484079:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1782228871.484109:0:6600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e636d0 00002000:00100000:1.0:1782228871.484123:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98fe77bcc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782228871.484127:0:6600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1782228871.484131:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1782228871.484276:0:6600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782228871.484422:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782228871.484472:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe77bcf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782228871.484517:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1868802329431680:12345-0@lo:8: Request processed in 459us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.484524:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782228871.484582:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98fe50c8d880 x1868802329431680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782228881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228871.484593:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782228871.484601:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782228871.484609:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782228871.484613:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1782228871.484616:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe77a81800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782228871.484626:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782228871.484632:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329431680:0@lo:8: 00010000:00080000:1.0:1782228871.484663:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e79500 x1868802329432320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228871.484687:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329432320:0@lo:400: 00010000:00080000:1.0:1782228871.484699:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e7bb80 x1868802329432192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228871.484707:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329432192:0@lo:400: 00010000:00080000:1.0:1782228871.484730:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e79880 x1868802329431936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228871.484738:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329431936:0@lo:400: 00010000:00080000:1.0:1782228871.484747:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe74e7b480 x1868802329432064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228871.484755:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329432064:0@lo:400: 00000100:00100000:1.0:1782228871.484775:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329431808 00000100:00100000:1.0:1782228871.484778:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329431808 00000100:00100000:1.0:1782228871.484803:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782228871.484819:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:7530:x1868802329431808:12345-0@lo:502: 00000100:00100000:1.0:1782228871.485037:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:7530:x1868802329431808:12345-0@lo:502: Request processed in 228us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228871.485043:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782228871.485370:0:7530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:7530:1868802329431808:0@lo:502: 00000020:01000000:2.0:1782228871.485402:0:7530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228871.485408:0:7530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228871.485410:0:7530:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782228871.485414:0:7530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:3.0:1782228871.485483:0:7531:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782228871.485566:0:7531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 184482134704ns, next at 0ns, rc = 0 00000020:01000000:3.0:1782228871.496731:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782228871.496765:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782228871.496776:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.496818:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228871.496847:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782228871.496850:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff98fe68ea3380 from 1 10000000:01000000:3.0:1782228871.496853:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782228871.496889:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.496897:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.496909:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228871.496932:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329432448:0@lo:101: 00000100:00100000:3.0:1782228871.497025:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.497070:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782228871.497097:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432448 00000100:00100000:3.0:1782228871.497105:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432448 00000100:00100000:3.0:1782228871.497266:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782228871.497276:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329432448:12345-0@lo:101: 00010000:00010000:3.0:1782228871.497291:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228871.497305:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e636d7 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.497328:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.497353:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.497362:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53378a00, rc 0) 00000100:00100000:3.0:1782228871.497401:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329432448:12345-0@lo:101: Request processed in 127us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228871.497408:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782228871.497489:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329432448:0@lo:101: 00010000:00010000:3.0:1782228871.497504:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.497512:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228871.497561:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329432576:0@lo:501: 00000100:00100000:3.0:1782228871.497585:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.497599:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782228871.498840:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432576 00000100:00100000:1.0:1782228871.498848:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432576 00000100:00100000:1.0:1782228871.498892:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782228871.498899:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329432576:12345-0@lo:501: 00000100:00100000:1.0:1782228871.499395:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329432576:12345-0@lo:501: Request processed in 494us (1806us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782228871.499413:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782228871.503803:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329432576:0@lo:501: 10000000:01000000:3.0:1782228871.503885:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782228871.503898:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228871.503910:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782228871.543664:0:7532:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782228871.543722:0:7532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329432832:0@lo:7: 00000100:00100000:3.0:1782228871.543800:0:7532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.543863:0:7532:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0300 going to sleep for 11 seconds 00000004:00080000:3.0:1782228871.543894:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1782228871.543919:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329432704:0@lo:13: 00000100:00100000:3.0:1782228871.544153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.544210:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432832 00000100:00100000:3.0:1782228871.544219:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432832 00000100:00100000:3.0:1782228871.544363:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782228871.544373:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7532:x1868802329432832:12345-0@lo:7: 00000100:00100000:2.0:1782228871.545117:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432704 00000100:00100000:2.0:1782228871.545123:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432704 00000100:00100000:2.0:1782228871.545157:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782228871.545166:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329432704:12345-0@lo:13: 00002000:00000024:2.0:1782228871.545181:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1782228871.545254:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329432704:12345-0@lo:13: Request processed in 88us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.545261:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1782228871.545489:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782228871.549128:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1782228871.549196:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff98fe81998700 x1868802329432704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228871.549224:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329432704:0@lo:13: 00002000:00080000:3.0:1782228871.555827:0:6600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1782228871.555836:0:6600:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782228871.555941:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7532:x1868802329432832:12345-0@lo:7: Request processed in 11565us (12136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228871.555967:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782228871.556263:0:7532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81998a80 x1868802329432832/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782228887 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228871.556278:0:7532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329432832:0@lo:7: 00000004:00080000:3.0:1782228871.556293:0:7532:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782228871.556334:0:7532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329432960:0@lo:5: 00000100:00100000:3.0:1782228871.556381:0:7532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228871.556656:0:7532:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1782228871.556677:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329432960 00000100:00100000:3.0:1782228871.556692:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329432960 00000100:00100000:3.0:1782228871.556737:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782228871.556746:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7532:x1868802329432960:12345-0@lo:5: 00002000:00080000:3.0:1782228871.556773:0:6599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782228871.556784:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1782228871.558282:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7532:x1868802329432960:12345-0@lo:5: Request processed in 1532us (1909us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782228871.558291:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1782228871.558352:0:7532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81998a80 x1868802329432960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782228887 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228871.558369:0:7532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329432960:0@lo:5: 00000004:00080000:2.0:1782228871.558382:0:7532:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782228871.558418:0:7532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329433088:0@lo:700: 00000100:00100000:2.0:1782228871.558468:0:7532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228871.558826:0:7532:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4465c180 going to sleep for 11 seconds 00000100:00100000:0.0:1782228871.560549:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433088 00000100:00100000:0.0:1782228871.560562:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433088 00000100:00100000:0.0:1782228871.562553:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782228871.562570:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7532:x1868802329433088:12345-0@lo:700: 00000100:00100000:0.0:1782228871.562635:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6606:1868802329433216:0@lo:700: 00000100:00100000:0.0:1782228871.562700:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228871.562738:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782228871.562944:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433216 00000100:00100000:2.0:1782228871.562951:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433216 00000100:00100000:2.0:1782228871.562990:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782228871.562998:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6606:x1868802329433216:12345-0@lo:700: 40000000:02000000:3.0:1782228871.644215:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1782228871.657604:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6606:x1868802329433216:12345-0@lo:700: Request processed in 94593us (94889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228871.657621:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782228871.660052:0:6606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe446af480 x1868802329433216/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782228887 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228871.660071:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6606:1868802329433216:0@lo:700: 40000000:02000000:2.0:1782228871.660087:0:6606:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1782228871.771546:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1782228871.771562:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1782228871.772276:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7532:x1868802329433088:12345-0@lo:700: Request processed in 209706us (213802us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228871.772289:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782228871.773120:0:7532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe50c8f480 x1868802329433088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782228887 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228871.773133:0:7532:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782228871.773150:0:7532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329433088:0@lo:700: 00000004:02000040:2.0:1782228871.808796:0:7532:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1782228871.820707:0:7532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329433344:0@lo:5: 00000100:00100000:0.0:1782228871.820784:0:7532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228871.820860:0:7532:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60600 going to sleep for 11 seconds 00000100:00100000:3.0:1782228871.821100:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433344 00000100:00100000:3.0:1782228871.821108:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433344 00000100:00100000:3.0:1782228871.821176:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782228871.821185:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7532:x1868802329433344:12345-0@lo:5: 00002000:00080000:0.0:1782228871.843346:0:6599:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782228871.843369:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1782228871.849520:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7532:x1868802329433344:12345-0@lo:5: Request processed in 28329us (28729us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782228871.849535:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782228871.853345:0:7532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe446ace00 x1868802329433344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782228887 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228871.853391:0:7532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7532:1868802329433344:0@lo:5: 00000004:00080000:2.0:1782228871.853408:0:7532:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1782228872.315619:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329433472:0@lo:13: 00000100:00100000:3.0:1782228872.315734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228872.315847:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433472 00000100:00100000:3.0:1782228872.315857:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433472 00000100:00100000:3.0:1782228872.315916:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782228872.315928:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329433472:12345-0@lo:13: 00002000:00000024:3.0:1782228872.315980:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228872.316042:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329433472:12345-0@lo:13: Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228872.316074:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1782228872.316097:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782228872.316141:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81998a80 x1868802329433472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228872.316167:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329433472:0@lo:13: 00010000:00010000:1.0:1782228872.574605:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228873.595703:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228874.620306:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228875.643772:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228876.668059:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782228876.744268:0:7853:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1782228876.925511:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329433728:0@lo:400: 00000100:00100000:3.0:1782228876.925589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228876.925642:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329434240:0@lo:400: 00000100:00100000:3.0:1782228876.925667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228876.925699:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782228876.925719:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329433600:0@lo:400: 00000100:00100000:3.0:1782228876.925749:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228876.925769:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329434112:0@lo:400: 00000100:00100000:3.0:1782228876.925794:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228876.925826:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329434240 00000100:00100000:3.0:1782228876.925833:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329434240 00000100:00100000:3.0:1782228876.925916:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782228876.925925:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329434240:12345-0@lo:400: 00000100:00100000:3.0:1782228876.925983:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329434240:12345-0@lo:400: Request processed in 59us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228876.925990:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782228876.926013:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433600 00000100:00100000:3.0:1782228876.926017:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433600 00000100:00100000:3.0:1782228876.926040:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782228876.926046:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329433600:12345-0@lo:400: 00000100:00100000:3.0:1782228876.926077:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329433600:12345-0@lo:400: Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228876.926101:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1782228876.926129:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782228876.926158:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329433600:0@lo:400: 00010000:00080000:3.0:1782228876.926174:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81998e00 x1868802329434240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228876.926185:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329434240:0@lo:400: 00000100:00100000:0.0:1782228876.931894:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329433856:0@lo:400: 00000100:00100000:0.0:1782228876.931988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228876.932024:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329434368:0@lo:13: 00000100:00100000:0.0:1782228876.932049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228876.932077:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782228876.932091:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329433984:0@lo:400: 00000100:00100000:0.0:1782228876.932117:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228876.932206:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433728 00000100:00100000:0.0:1782228876.932214:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433728 00000100:00100000:0.0:1782228876.932250:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329434112 00000100:00100000:0.0:1782228876.932253:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329434112 00000100:00100000:0.0:1782228876.932275:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433856 00000100:00100000:0.0:1782228876.932277:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433856 00000100:00100000:0.0:1782228876.932292:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782228876.932301:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329433728:12345-0@lo:400: 00000100:00100000:0.0:1782228876.932360:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329433728:12345-0@lo:400: Request processed in 59us (6770us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228876.932367:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782228876.932383:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782228876.932388:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329434112:12345-0@lo:400: 00000100:00100000:0.0:1782228876.932415:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329434112:12345-0@lo:400: Request processed in 27us (6620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228876.932421:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782228876.932454:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782228876.932460:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329433856:12345-0@lo:400: 00000100:00100000:0.0:1782228876.932491:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329433856:12345-0@lo:400: Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228876.932496:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782228876.932512:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329434368 00000100:00100000:0.0:1782228876.932515:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329434368 00000100:00100000:0.0:1782228876.932537:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782228876.932543:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329434368:12345-0@lo:13: 00002000:00000024:0.0:1782228876.932571:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228876.932608:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329434368:12345-0@lo:13: Request processed in 65us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228876.932615:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782228876.932633:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329433984 00000100:00100000:0.0:1782228876.932636:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329433984 00000100:00100000:0.0:1782228876.932661:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782228876.932666:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329433984:12345-0@lo:400: 00000100:00100000:0.0:1782228876.932697:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329433984:12345-0@lo:400: Request processed in 31us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228876.932720:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782228876.932776:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81999180 x1868802329433984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228876.932790:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329433984:0@lo:400: 00010000:00080000:0.0:1782228876.932801:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81998380 x1868802329433856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228876.932810:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329433856:0@lo:400: 00010000:00080000:0.0:1782228876.932819:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe50c8f480 x1868802329434368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228876.932832:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329434368:0@lo:13: 00000100:00080000:3.0:1782228876.935505:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228876.935518:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782228876.935604:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe8199a680 x1868802329434112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228876.935623:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329434112:0@lo:400: 00010000:00080000:3.0:1782228876.935638:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81999880 x1868802329433728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228876.935646:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329433728:0@lo:400: 00000001:00080000:3.0:1782228877.045106:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1782228877.440743:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228877.440773:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329434496:0@lo:13: 00000100:00100000:3.0:1782228877.440855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228877.440941:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329434496 00000100:00100000:3.0:1782228877.440950:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329434496 00000100:00100000:3.0:1782228877.441001:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782228877.441011:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329434496:12345-0@lo:13: 00002000:00000024:3.0:1782228877.441051:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228877.441101:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329434496:12345-0@lo:13: Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228877.441128:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782228877.441183:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81999880 x1868802329434496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228877.441205:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329434496:0@lo:13: 00010000:00010000:0.0:1782228877.691615:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228878.715749:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228879.741540:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228880.776468:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228881.790964:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228882.052687:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329434624:0@lo:13: 00000100:00100000:1.0:1782228882.052775:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228882.052859:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329434624 00000100:00100000:1.0:1782228882.052866:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329434624 00000100:00100000:1.0:1782228882.052915:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782228882.052925:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329434624:12345-0@lo:13: 00002000:00000024:1.0:1782228882.052964:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228882.053008:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329434624:12345-0@lo:13: Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228882.053015:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1782228882.053035:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782228882.053066:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe74e7b480 x1868802329434624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228882.053077:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782228882.053094:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329434624:0@lo:13: 00000100:00100000:2.0:1782228882.073891:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329434880:0@lo:400: 00000100:00100000:2.0:1782228882.073957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228882.073995:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782228882.074000:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329435008:0@lo:400: 00000100:00100000:2.0:1782228882.074020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228882.074068:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329434880 00000100:00100000:2.0:1782228882.074075:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329434880 00000100:00100000:2.0:1782228882.074119:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435008 00000100:00100000:2.0:1782228882.074121:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435008 00000100:00100000:2.0:1782228882.074145:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782228882.074153:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329434880:12345-0@lo:400: 00000100:00100000:2.0:1782228882.074201:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329434880:12345-0@lo:400: Request processed in 48us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228882.074207:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782228882.074223:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782228882.074228:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329435008:12345-0@lo:400: 00000100:00100000:2.0:1782228882.074251:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329435008:12345-0@lo:400: Request processed in 24us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228882.074256:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782228882.074290:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e7aa00 x1868802329435008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228882.074303:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329435008:0@lo:400: 00010000:00080000:2.0:1782228882.074319:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe50c8f480 x1868802329434880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228882.074327:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329434880:0@lo:400: 00000100:00080000:2.0:1782228882.074789:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228882.074805:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329435136:0@lo:400: 00000100:00100000:2.0:1782228882.074835:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228882.074856:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782228882.074861:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329434752:0@lo:400: 00000100:00100000:2.0:1782228882.074884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228882.074907:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329435264:0@lo:400: 00000100:00100000:2.0:1782228882.074926:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228882.074947:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435264 00000100:00100000:2.0:1782228882.074950:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435264 00000100:00100000:2.0:1782228882.074975:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782228882.074981:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329435264:12345-0@lo:400: 00000100:00100000:2.0:1782228882.075013:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329435264:12345-0@lo:400: Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228882.075018:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782228882.076230:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782228882.076265:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e78a80 x1868802329435264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782228898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228882.076277:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329435264:0@lo:400: 00000100:00100000:3.0:1782228882.076420:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435136 00000100:00100000:3.0:1782228882.076425:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435136 00000100:00100000:3.0:1782228882.076500:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782228882.076508:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329435136:12345-0@lo:400: 00000100:00100000:3.0:1782228882.076566:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329435136:12345-0@lo:400: Request processed in 59us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.076572:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782228882.076613:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e78700 x1868802329435136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228882.076622:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329435136:0@lo:400: 00000100:00080000:2.0:1782228882.077276:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782228882.091638:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329434752 00000100:00100000:1.0:1782228882.091654:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329434752 00000100:00100000:1.0:1782228882.091724:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782228882.091733:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329434752:12345-0@lo:400: 00000100:00100000:1.0:1782228882.091831:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329434752:12345-0@lo:400: Request processed in 98us (16944us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228882.091838:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782228882.092049:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329434752:0@lo:400: 00000100:00100000:0.0:1782228882.463046:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.463163:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309488768 00000100:00100000:3.0:1782228882.463176:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309488768 00000100:00100000:3.0:1782228882.463224:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110 00000100:00100000:3.0:1782228882.463234:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2369:x1868802309488768:12345-192.168.204.22@tcp:250: 00010000:00080000:3.0:1782228882.463264:0:5790:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4e285f6c-2f3f-46f5-8113-fe389a782fea@192.168.204.22@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1782228882.463295:0:5790:0:(genops.c:1406:class_connect()) connect: client 4e285f6c-2f3f-46f5-8113-fe389a782fea, cookie 0x8e1c8a3488e636e5 00000100:00080000:3.0:1782228882.463634:0:5790:0:(import.c:65:import_set_state_nolock()) ffff98fe7d890000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782228882.463864:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+5:2369:x1868802309488768:12345-192.168.204.22@tcp:250: Request processed in 629us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.463873:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110 00000100:00100000:0.0:1782228882.482666:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.482985:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309488896 00000100:00100000:3.0:1782228882.482999:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309488896 00000100:00100000:3.0:1782228882.483083:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 111 00000100:00100000:3.0:1782228882.483094:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+5:5571:x1868802309488896:12345-192.168.204.22@tcp:101: 00010000:00010000:3.0:1782228882.483116:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228882.483153:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99495dd expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228882.483191:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228882.483205:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228882.483218:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53379e00, rc 0) 00000100:00100000:3.0:1782228882.483295:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+6:5571:x1868802309488896:12345-192.168.204.22@tcp:101: Request processed in 203us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.483303:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 111 00000100:00100000:2.0:1782228882.493260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228882.493404:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489024 00000100:00100000:0.0:1782228882.493417:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489024 00000100:00100000:0.0:1782228882.493525:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 112 00000100:00100000:0.0:1782228882.493536:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+6:5571:x1868802309489024:12345-192.168.204.22@tcp:501: 00000100:00100000:0.0:1782228882.493943:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+6:5571:x1868802309489024:12345-192.168.204.22@tcp:501: Request processed in 407us (696us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782228882.493952:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 112 00000100:00100000:2.0:1782228882.506365:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228882.506515:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489152 00000100:00100000:0.0:1782228882.506531:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489152 00000100:00100000:0.0:1782228882.506612:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 113 00000100:00100000:0.0:1782228882.506625:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+6:5571:x1868802309489152:12345-192.168.204.22@tcp:101: 00010000:00010000:0.0:1782228882.506648:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228882.506673:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99495e4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228882.506710:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228882.506724:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228882.506988:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030c00, rc 0) 00000100:00100000:0.0:1782228882.507104:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+7:5571:x1868802309489152:12345-192.168.204.22@tcp:101: Request processed in 480us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228882.507112:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 113 00000100:00100000:2.0:1782228882.530534:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.530701:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489280 00000100:00100000:3.0:1782228882.530723:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489280 00000100:00100000:3.0:1782228882.530804:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 114 00000100:00100000:3.0:1782228882.530816:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+7:5571:x1868802309489280:12345-192.168.204.22@tcp:501: 00000100:00100000:3.0:1782228882.531178:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5571:x1868802309489280:12345-192.168.204.22@tcp:501: Request processed in 363us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.531186:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 114 00000100:00100000:3.0:1782228882.535996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228882.536174:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489408 00000100:00100000:0.0:1782228882.536186:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489408 00000100:00100000:0.0:1782228882.536256:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 115 00000100:00100000:0.0:1782228882.536267:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5571:x1868802309489408:12345-192.168.204.22@tcp:503: 00000100:00100000:0.0:1782228882.536965:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5571:x1868802309489408:12345-192.168.204.22@tcp:503: Request processed in 696us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228882.536985:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 115 00000100:00100000:2.0:1782228882.548220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228882.548420:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489536 00000100:00100000:0.0:1782228882.548471:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489536 00000100:00100000:0.0:1782228882.548558:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 116 00000100:00100000:0.0:1782228882.548571:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5589:x1868802309489536:12345-192.168.204.22@tcp:502: 00000100:00100000:0.0:1782228882.549000:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5589:x1868802309489536:12345-192.168.204.22@tcp:502: Request processed in 430us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228882.549010:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 116 00000100:00100000:3.0:1782228882.562326:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329435392:0@lo:13: 00000100:00100000:3.0:1782228882.562473:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228882.562698:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435392 00000100:00100000:0.0:1782228882.562708:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435392 00000100:00100000:0.0:1782228882.562784:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782228882.562933:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329435392:12345-0@lo:13: 00002000:00000024:0.0:1782228882.562986:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228882.563044:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329435392:12345-0@lo:13: Request processed in 250us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228882.563051:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782228882.563154:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe446adc00 x1868802329435392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228882.563178:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329435392:0@lo:13: 00000100:00100000:1.0:1782228882.606762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.606870:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489664 00000100:00100000:3.0:1782228882.606883:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489664 00000100:00100000:3.0:1782228882.606960:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 117 00000100:00100000:3.0:1782228882.606972:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5589:x1868802309489664:12345-192.168.204.22@tcp:502: 00000100:00100000:3.0:1782228882.607775:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5589:x1868802309489664:12345-192.168.204.22@tcp:502: Request processed in 803us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.607786:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 117 00000100:00100000:3.0:1782228882.620147:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228882.620374:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489792 00000100:00100000:2.0:1782228882.620387:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489792 00000100:00100000:2.0:1782228882.620484:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 118 00000100:00100000:2.0:1782228882.620572:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5571:x1868802309489792:12345-192.168.204.22@tcp:101: 00010000:00010000:2.0:1782228882.620601:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228882.620625:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b2e00/0x8e1c8a3488e636fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994960e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228882.620661:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b2e00/0x8e1c8a3488e636fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994960e expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228882.620673:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b2e00/0x8e1c8a3488e636fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994960e expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228882.620682:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b2e00, rc 0) 00000100:00100000:2.0:1782228882.620757:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5571:x1868802309489792:12345-192.168.204.22@tcp:101: Request processed in 189us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228882.620765:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 118 00000100:00100000:2.0:1782228882.628068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228882.628250:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309489920 00000100:00100000:0.0:1782228882.628264:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309489920 00000100:00100000:0.0:1782228882.628341:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 119 00000100:00100000:0.0:1782228882.628352:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5571:x1868802309489920:12345-192.168.204.22@tcp:256: 20000000:01000000:0.0:1782228882.628384:0:5792:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782228882.628411:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782228882.628415:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782228882.628419:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782228882.628421:0:5792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1782228882.637901:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5571:x1868802309489920:12345-192.168.204.22@tcp:256: Request processed in 9534us (9830us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.637919:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 119 00000100:00100000:2.0:1782228882.647308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.647517:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490048 00000100:00100000:3.0:1782228882.647530:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490048 00000100:00100000:3.0:1782228882.647608:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 120 00000100:00100000:3.0:1782228882.647619:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5571:x1868802309490048:12345-192.168.204.22@tcp:101: 00010000:00010000:3.0:1782228882.647641:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228882.647663:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949615 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228882.647700:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228882.647724:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228882.647759:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe53378800, rc 0) 00000100:00100000:3.0:1782228882.647841:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5571:x1868802309490048:12345-192.168.204.22@tcp:101: Request processed in 224us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.647849:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 120 00000100:00100000:2.0:1782228882.651398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.651606:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490176 00000100:00100000:3.0:1782228882.651618:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490176 00000100:00100000:3.0:1782228882.651687:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 121 00000100:00100000:3.0:1782228882.651697:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5571:x1868802309490176:12345-192.168.204.22@tcp:501: 00000100:00100000:3.0:1782228882.652088:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5571:x1868802309490176:12345-192.168.204.22@tcp:501: Request processed in 391us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.652097:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 121 00000100:00100000:3.0:1782228882.659232:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228882.660330:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490304 00000100:00100000:2.0:1782228882.660347:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490304 00000100:00100000:2.0:1782228882.660460:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 122 00000100:00100000:2.0:1782228882.660472:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5571:x1868802309490304:12345-192.168.204.22@tcp:503: 00000100:00100000:2.0:1782228882.661141:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5571:x1868802309490304:12345-192.168.204.22@tcp:503: Request processed in 670us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228882.661160:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 122 00000100:00100000:0.0:1782228882.668387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228882.673712:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490432 00000100:00100000:2.0:1782228882.673735:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490432 00000100:00100000:2.0:1782228882.674118:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 123 00000100:00100000:2.0:1782228882.674130:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5593:x1868802309490432:12345-192.168.204.22@tcp:502: 00000100:00100000:2.0:1782228882.678103:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5593:x1868802309490432:12345-192.168.204.22@tcp:502: Request processed in 3951us (9707us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228882.678122:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 123 00000100:00100000:2.0:1782228882.680772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.680869:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490560 00000100:00100000:3.0:1782228882.680881:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490560 00000100:00100000:3.0:1782228882.680944:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 124 00000100:00100000:3.0:1782228882.680956:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5593:x1868802309490560:12345-192.168.204.22@tcp:502: 00000100:00100000:3.0:1782228882.681274:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5593:x1868802309490560:12345-192.168.204.22@tcp:502: Request processed in 319us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.681293:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 124 00000100:00100000:2.0:1782228882.691962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228882.692097:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490688 00000100:00100000:3.0:1782228882.692109:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490688 00000100:00100000:3.0:1782228882.692160:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:3.0:1782228882.692170:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2369:x1868802309490688:12345-192.168.204.22@tcp:38: 00010000:00080000:3.0:1782228882.692204:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1782228882.692290:0:5796:0:(genops.c:1406:class_connect()) connect: client 2d74cab1-6977-468d-a933-6ac020ef49f3, cookie 0x8e1c8a3488e63708 00000004:00100000:3.0:1782228882.692329:0:5796:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1782228882.692336:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1782228882.721055:0:5796:0:(import.c:65:import_set_state_nolock()) ffff98fe7d8b6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782228882.721173:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2369:x1868802309490688:12345-192.168.204.22@tcp:38: Request processed in 29001us (29224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228882.721188:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 4 00010000:00010000:2.0:1782228882.811654:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228883.730045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228883.730102:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228883.730303:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490944 00000100:00100000:2.0:1782228883.730315:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490944 00000100:00100000:2.0:1782228883.730416:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309490816 00000100:00100000:2.0:1782228883.730419:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309490816 00000100:00100000:2.0:1782228883.730490:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:2.0:1782228883.730502:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:5571:x1868802309490944:12345-192.168.204.22@tcp:41: 00000004:00000024:2.0:1782228883.730562:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782228883.730741:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:5571:x1868802309490944:12345-192.168.204.22@tcp:41: Request processed in 241us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228883.730749:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:2.0:1782228883.730771:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:2.0:1782228883.730777:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:0:x1868802309490816:12345-192.168.204.22@tcp:41: 00000004:00000024:2.0:1782228883.730789:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782228883.730813:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:0:x1868802309490816:12345-192.168.204.22@tcp:41: Request processed in 35us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228883.730837:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00080000:0.0:1782228883.731016:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228883.739667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228883.739798:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491072 00000100:00100000:3.0:1782228883.739810:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491072 00000100:00100000:3.0:1782228883.739891:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:3.0:1782228883.739903:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5571:x1868802309491072:12345-192.168.204.22@tcp:40: 00000100:00100000:3.0:1782228883.740019:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5571:x1868802309491072:12345-192.168.204.22@tcp:40: Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228883.740028:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:3.0:1782228883.744398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228883.750626:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491200 00000100:00100000:0.0:1782228883.750647:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491200 00000100:00100000:0.0:1782228883.750727:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:0.0:1782228883.750738:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2369:x1868802309491200:12345-192.168.204.22@tcp:8: 00010000:00080000:0.0:1782228883.750780:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1782228883.750825:0:6600:0:(genops.c:1406:class_connect()) connect: client 2d74cab1-6977-468d-a933-6ac020ef49f3, cookie 0x8e1c8a3488e6370f 00002000:00100000:0.0:1782228883.750840:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2d74cab1-6977-468d-a933-6ac020ef49f3/ffff98fe77c4b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782228883.750854:0:6600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782228883.751292:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782228883.751337:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe77c4f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782228883.754895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228883.754948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228883.754983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228883.755065:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491584 00000100:00100000:1.0:1782228883.755077:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491584 00000100:00100000:1.0:1782228883.755144:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:1.0:1782228883.755155:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5571:x1868802309491584:12345-192.168.204.22@tcp:33: 00000100:00100000:2.0:1782228883.755547:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491456 00000100:00100000:2.0:1782228883.755553:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491456 00000100:00100000:2.0:1782228883.755596:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 125 00000100:00100000:2.0:1782228883.755604:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309491456:12345-192.168.204.22@tcp:400: 00000100:00100000:2.0:1782228883.755685:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309491456:12345-192.168.204.22@tcp:400: Request processed in 82us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228883.755693:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 125 00000100:00100000:0.0:1782228883.755963:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2369:x1868802309491200:12345-192.168.204.22@tcp:8: Request processed in 5223us (11703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228883.755974:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:0.0:1782228883.755997:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491328 00000100:00100000:0.0:1782228883.756001:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491328 00000100:00100000:0.0:1782228883.756022:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:0.0:1782228883.756027:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2369:x1868802309491328:12345-192.168.204.22@tcp:8: 00010000:00080000:0.0:1782228883.756058:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1782228883.756094:0:6600:0:(genops.c:1406:class_connect()) connect: client 2d74cab1-6977-468d-a933-6ac020ef49f3, cookie 0x8e1c8a3488e63716 00002000:00100000:0.0:1782228883.756108:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2d74cab1-6977-468d-a933-6ac020ef49f3/ffff98fe77c4a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782228883.756124:0:6600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782228883.758995:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782228883.759078:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe77c49000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782228883.759164:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2369:x1868802309491328:12345-192.168.204.22@tcp:8: Request processed in 3133us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228883.759177:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000004:00080000:0.0:1782228883.785224:0:5799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29975us 00000004:00200000:0.0:1782228883.826852:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782228883.827115:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5571:x1868802309491584:12345-192.168.204.22@tcp:33: Request processed in 71952us (72120us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228883.827136:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00010000:00010000:3.0:1782228883.839485:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228883.994395:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228883.994466:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491712 00000100:00100000:1.0:1782228883.994479:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491712 00000100:00100000:1.0:1782228883.994559:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:2.0:1782228883.994674:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5610:x1868802309491712:12345-192.168.204.22@tcp:101: 00010000:00010000:2.0:1782228883.994701:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228883.996831:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b3a00/0x8e1c8a3488e6371d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994963f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228883.996919:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b2a00/0x8e1c8a3488e63724 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228883.996934:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b2a00/0x8e1c8a3488e63724 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228883.998051:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b2a00/0x8e1c8a3488e63724 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782228883.998308:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782228883.998313:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782228883.998822:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b2a00/0x8e1c8a3488e63724 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228883.998873:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b3a00/0x8e1c8a3488e6371d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994963f expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228883.998893:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b2a00/0x8e1c8a3488e63724 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994963f expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228883.998902:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:2.0:1782228883.998904:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782228883.998908:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b2a00, rc 0) 00000100:00100000:2.0:1782228883.998989:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:5610:x1868802309491712:12345-192.168.204.22@tcp:101: Request processed in 4410us (4607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228883.998998:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00010000:00010000:2.0:1782228884.859701:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228885.885358:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228886.137646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228886.137782:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491840 00000100:00100000:2.0:1782228886.137795:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491840 00000100:00080000:0.0:1782228886.137990:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228886.138055:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:2.0:1782228886.138068:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:5662:x1868802309491840:12345-192.168.204.22@tcp:41: 00000004:00000024:2.0:1782228886.138132:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782228886.138275:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:5662:x1868802309491840:12345-192.168.204.22@tcp:41: Request processed in 209us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228886.138284:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:3.0:1782228886.148339:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228886.148469:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309491968 00000100:00100000:0.0:1782228886.148483:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309491968 00000100:00100000:0.0:1782228886.148589:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:0.0:1782228886.148602:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5662:x1868802309491968:12345-192.168.204.22@tcp:13: 00002000:00000024:0.0:1782228886.148657:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228886.148973:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5662:x1868802309491968:12345-192.168.204.22@tcp:13: Request processed in 372us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228886.148982:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00080000:2.0:1782228886.149555:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782228886.155585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228886.164140:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492096 00000100:00100000:3.0:1782228886.164165:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492096 00000100:00100000:3.0:1782228886.164364:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:3.0:1782228886.164377:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5662:x1868802309492096:12345-192.168.204.22@tcp:13: 00002000:00000024:3.0:1782228886.164448:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228886.164574:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2d74cab1-6977-468d-a933-6ac020ef49f3+6:5662:x1868802309492096:12345-192.168.204.22@tcp:13: Request processed in 199us (9005us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228886.164582:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00080000:2.0:1782228886.170619:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782228886.907922:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228887.163892:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329435520:0@lo:13: 00000100:00100000:3.0:1782228887.163996:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228887.164149:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435520 00000100:00100000:1.0:1782228887.164160:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435520 00000100:00100000:1.0:1782228887.164248:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782228887.164260:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329435520:12345-0@lo:13: 00002000:00000024:1.0:1782228887.164290:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228887.164345:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329435520:12345-0@lo:13: Request processed in 87us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228887.164354:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1782228887.164460:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782228887.164496:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe74e79180 x1868802329435520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228887.164531:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329435520:0@lo:13: 00000100:00100000:1.0:1782228887.173042:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329435648:0@lo:400: 00000100:00100000:1.0:1782228887.173136:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228887.173228:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329435776:0@lo:400: 00000100:00100000:1.0:1782228887.173258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228887.173298:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435776 00000100:00100000:1.0:1782228887.173306:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435776 00000100:00100000:1.0:1782228887.173359:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782228887.173369:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329435776:12345-0@lo:400: 00000100:00100000:1.0:1782228887.173467:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329435776:12345-0@lo:400: Request processed in 98us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228887.173475:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782228887.173539:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329435776:0@lo:400: 00000100:00100000:1.0:1782228887.173581:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329435904:0@lo:400: 00000100:00100000:1.0:1782228887.173630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228887.173660:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435904 00000100:00100000:1.0:1782228887.173663:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435904 00000100:00100000:1.0:1782228887.173691:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782228887.173698:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329435904:12345-0@lo:400: 00000100:00100000:1.0:1782228887.173729:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329435904:12345-0@lo:400: Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228887.173734:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782228887.173758:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329435904:0@lo:400: 00000100:00080000:1.0:1782228887.173775:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228887.173802:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329436032:0@lo:400: 00000100:00100000:1.0:1782228887.173829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228887.173875:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329436160:0@lo:400: 00000100:00100000:1.0:1782228887.173907:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228887.173933:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436160 00000100:00100000:1.0:1782228887.173937:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436160 00000100:00100000:1.0:1782228887.173963:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782228887.173969:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329436160:12345-0@lo:400: 00000100:00100000:1.0:1782228887.174002:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329436160:12345-0@lo:400: Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228887.174008:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782228887.174034:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329436160:0@lo:400: 00000100:00080000:1.0:1782228887.174046:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228887.174160:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329435648 00000100:00100000:2.0:1782228887.174165:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329435648 00000100:00100000:2.0:1782228887.174204:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782228887.174211:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329435648:12345-0@lo:400: 00000100:00100000:2.0:1782228887.174260:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329435648:12345-0@lo:400: Request processed in 50us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228887.174267:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782228887.176081:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329435648:0@lo:400: 00000100:00100000:0.0:1782228887.176233:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436032 00000100:00100000:0.0:1782228887.176242:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436032 00000100:00100000:0.0:1782228887.176307:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782228887.176317:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329436032:12345-0@lo:400: 00000100:00100000:0.0:1782228887.176408:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329436032:12345-0@lo:400: Request processed in 93us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228887.176417:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1782228887.177973:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782228887.178027:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c4e00 x1868802329436032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228887.178044:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329436032:0@lo:400: 00000100:00100000:1.0:1782228887.681017:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329436288:0@lo:13: 00000100:00100000:1.0:1782228887.681128:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228887.683517:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436288 00000100:00100000:2.0:1782228887.683540:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436288 00000100:00100000:2.0:1782228887.683624:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782228887.683637:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329436288:12345-0@lo:13: 00002000:00000024:2.0:1782228887.684230:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228887.684356:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329436288:12345-0@lo:13: Request processed in 720us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228887.684365:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782228887.684883:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81998380 x1868802329436288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228887.684912:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329436288:0@lo:13: 00000001:00100000:1.0:1782228887.802596:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00010000:00010000:2.0:1782228887.932181:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782228888.250422:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000001:00100000:2.0:1782228888.780180:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00010000:00010000:3.0:1782228888.964888:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228889.167501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228889.167542:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228889.167571:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228889.167601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228889.167713:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492480 00000100:00100000:0.0:1782228889.167722:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492480 00000100:00100000:0.0:1782228889.167783:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492608 00000100:00100000:0.0:1782228889.167787:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492608 00000100:00100000:0.0:1782228889.167809:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:0.0:1782228889.167818:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309492480:12345-192.168.204.22@tcp:400: 00000100:00100000:0.0:1782228889.167897:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309492480:12345-192.168.204.22@tcp:400: Request processed in 79us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228889.167904:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:0.0:1782228889.167938:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:0.0:1782228889.167945:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309492608:12345-192.168.204.22@tcp:400: 00000100:00100000:0.0:1782228889.167969:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309492608:12345-192.168.204.22@tcp:400: Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228889.167987:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:3.0:1782228889.168385:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492224 00000100:00100000:3.0:1782228889.168391:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492224 00000100:00100000:3.0:1782228889.168425:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 127 00000100:00100000:3.0:1782228889.168447:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309492224:12345-192.168.204.22@tcp:400: 00000100:00100000:3.0:1782228889.168493:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309492224:12345-192.168.204.22@tcp:400: Request processed in 60us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228889.168500:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 127 00000100:00080000:0.0:1782228889.168644:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782228889.168649:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782228889.168797:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492352 00000100:00100000:0.0:1782228889.168803:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492352 00000100:00100000:0.0:1782228889.168850:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:0.0:1782228889.168858:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309492352:12345-192.168.204.22@tcp:400: 00000100:00100000:0.0:1782228889.168895:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309492352:12345-192.168.204.22@tcp:400: Request processed in 38us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228889.168901:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00080000:3.0:1782228889.169198:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1782228889.183875:0:8161:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1782228889.979742:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228891.009271:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228892.032011:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228892.284642:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329436416:0@lo:13: 00000100:00100000:1.0:1782228892.284736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.284811:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329436928:0@lo:400: 00000100:00100000:1.0:1782228892.284843:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.284874:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782228892.284880:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329436544:0@lo:400: 00000100:00100000:1.0:1782228892.284910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.284933:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329437056:0@lo:400: 00000100:00100000:1.0:1782228892.284958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.284989:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329436672:0@lo:400: 00000100:00100000:1.0:1782228892.285014:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.285031:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329437184:0@lo:400: 00000100:00100000:1.0:1782228892.285050:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.285067:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782228892.285072:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329436800:0@lo:400: 00000100:00100000:1.0:1782228892.285095:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.285132:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436416 00000100:00100000:1.0:1782228892.285141:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436416 00000100:00100000:1.0:1782228892.285209:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782228892.285220:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329436416:12345-0@lo:13: 00002000:00000024:1.0:1782228892.285272:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228892.285326:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329436416:12345-0@lo:13: Request processed in 106us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228892.285334:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782228892.285363:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436928 00000100:00100000:1.0:1782228892.285367:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436928 00000100:00100000:1.0:1782228892.285398:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329437184 00000100:00100000:1.0:1782228892.285400:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329437184 00000100:00100000:0.0:1782228892.286110:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782228892.286124:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329436928:12345-0@lo:400: 00000100:00100000:0.0:1782228892.286193:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329436928:12345-0@lo:400: Request processed in 73us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228892.286200:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782228892.286225:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329437056 00000100:00100000:0.0:1782228892.286231:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329437056 00000100:00100000:0.0:1782228892.286259:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436672 00000100:00100000:0.0:1782228892.286262:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436672 00000100:00100000:0.0:1782228892.286276:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436800 00000100:00100000:0.0:1782228892.286278:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436800 00000100:00100000:0.0:1782228892.286293:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782228892.286300:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329437056:12345-0@lo:400: 00000100:00100000:0.0:1782228892.286333:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329437056:12345-0@lo:400: Request processed in 34us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228892.286340:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782228892.286354:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782228892.286360:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329436672:12345-0@lo:400: 00000100:00100000:0.0:1782228892.286395:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329436672:12345-0@lo:400: Request processed in 36us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228892.286412:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782228892.286452:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782228892.286459:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329436800:12345-0@lo:400: 00000100:00100000:0.0:1782228892.286491:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329436800:12345-0@lo:400: Request processed in 33us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228892.286496:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782228892.286522:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329436544 00000100:00100000:0.0:1782228892.286525:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329436544 00000100:00100000:0.0:1782228892.286557:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782228892.286564:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329436544:12345-0@lo:400: 00000100:00100000:0.0:1782228892.286603:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329436544:12345-0@lo:400: Request processed in 40us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228892.286691:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782228892.288383:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782228892.288421:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329437184:12345-0@lo:400: 00000100:00100000:1.0:1782228892.288532:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329437184:12345-0@lo:400: Request processed in 129us (3480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228892.288539:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1782228892.288579:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782228892.288586:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782228892.288589:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782228892.289352:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329436544:0@lo:400: 00000100:00100000:1.0:1782228892.289375:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329437056:0@lo:400: 00010000:00080000:1.0:1782228892.289393:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c6d80 x1868802329436416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228892.289452:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329436416:0@lo:13: 00010000:00080000:1.0:1782228892.289468:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c7480 x1868802329436928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228892.289477:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329436928:0@lo:400: 00000100:00100000:1.0:1782228892.289541:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329436800:0@lo:400: 00000100:00100000:1.0:1782228892.289554:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329436672:0@lo:400: 00010000:00080000:1.0:1782228892.289565:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c5500 x1868802329437184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228892.289573:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329437184:0@lo:400: 00000100:00100000:2.0:1782228892.796479:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329437312:0@lo:13: 00000100:00100000:2.0:1782228892.796581:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228892.800458:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329437312 00000100:00100000:1.0:1782228892.800481:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329437312 00000100:00100000:1.0:1782228892.800964:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782228892.800980:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329437312:12345-0@lo:13: 00002000:00000024:1.0:1782228892.801052:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228892.801172:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329437312:12345-0@lo:13: Request processed in 195us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228892.801180:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1782228892.801324:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe81999180 x1868802329437312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228892.801351:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329437312:0@lo:13: 00010000:00010000:0.0:1782228893.052093:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782228893.847768:0:8309:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1dde8190 20000000:00000080:1.0:1782228893.847791:0:8309:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fe741e1000 uarg=0000000000000000 20000000:01000000:1.0:1782228893.847842:0:8309:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1782228893.847845:0:8309:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1782228893.847849:0:8309:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1782228893.847854:0:8309:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1782228893.847861:0:8309:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1782228893.847880:0:8309:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782228893.847883:0:8309:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1782228893.848225:0:8309:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1782228893.848229:0:8309:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782228893.849293:0:8310:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1782228893.850012:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1782228893.850085:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1782228893.850123:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1782228893.850136:0:8309:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782228893.850139:0:8309:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782228893.851403:0:8311:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1782228893.852895:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1782228893.852956:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1782228893.852987:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1782228893.853001:0:8309:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782228893.853005:0:8309:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782228893.854006:0:8312:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1782228893.854696:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1782228893.854761:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1782228893.854791:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1782228893.854802:0:8309:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782228893.854805:0:8309:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782228893.855694:0:8313:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1782228893.856108:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1782228893.856165:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1782228893.856208:0:8309:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1782228893.856225:0:8309:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782228893.856250:0:8309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856274:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856283:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856291:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856298:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856304:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856312:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856319:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856330:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856338:0:8309:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856356:0:8309:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856419:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856658:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 9 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.856679:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437440:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782228893.856847:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856856:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 9 pid: 5792 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.856865:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437568:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782228893.856895:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.856903:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.856913:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437696:0@lo:104: 00000100:00100000:1.0:1782228893.856958:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228893.856997:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.857017:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 18 pid: 5791 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.857026:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437824:0@lo:104: 00000100:00100000:1.0:1782228893.857051:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228893.857078:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.857086:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.857095:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437952:0@lo:104: 00010000:00010000:1.0:1782228893.857116:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.857123:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.857131:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438080:0@lo:104: 00010000:00010000:1.0:1782228893.857149:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.857156:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 18 pid: 5790 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.857164:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438208:0@lo:104: 00010000:00010000:1.0:1782228893.857184:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.857202:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.857211:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438336:0@lo:104: 00010000:00010000:1.0:1782228893.857234:0:8309:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.857242:0:8309:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.857250:0:8309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438464:0@lo:104: 00000100:00100000:1.0:1782228893.857266:0:8309:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898300 going to sleep for 11 seconds 00000100:00100000:0.0:1782228893.857359:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782228893.857390:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.857402:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.857409:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.857417:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.857484:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.857497:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329437696 00000100:00100000:0.0:1782228893.857504:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329437696 00000100:00100000:0.0:1782228893.857549:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329437824 00000100:00100000:0.0:1782228893.857551:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329437824 00000100:00100000:0.0:1782228893.857560:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329437952 00000100:00100000:0.0:1782228893.857562:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329437952 00000100:00100000:0.0:1782228893.857569:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438080 00000100:00100000:0.0:1782228893.857645:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438080 00000100:00100000:0.0:1782228893.857660:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438208 00000100:00100000:0.0:1782228893.857662:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438208 00000100:00100000:0.0:1782228893.857672:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438336 00000100:00100000:0.0:1782228893.857674:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438336 00000100:00100000:0.0:1782228893.857682:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438464 00000100:00100000:0.0:1782228893.857684:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438464 00000100:00100000:0.0:1782228893.857696:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782228893.857706:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:8309:x1868802329437696:12345-0@lo:104: 00010000:00010000:0.0:1782228893.857721:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.857779:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782228893.857785:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+9:8309:x1868802329437696:12345-0@lo:104: Request processed in 81us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.857799:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782228893.857818:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782228893.857823:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+8:8309:x1868802329437824:12345-0@lo:104: 00010000:00010000:0.0:1782228893.857831:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.857861:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782228893.857867:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77ca9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+8:8309:x1868802329437824:12345-0@lo:104: Request processed in 43us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.857873:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782228893.857909:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782228893.857915:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+7:8309:x1868802329437952:12345-0@lo:104: 00010000:00010000:0.0:1782228893.857923:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.857951:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782228893.857955:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+7:8309:x1868802329437952:12345-0@lo:104: Request processed in 41us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.857960:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782228893.857970:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782228893.857975:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+6:8309:x1868802329438080:12345-0@lo:104: 00010000:00010000:0.0:1782228893.857982:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858002:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1782228893.858006:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+6:8309:x1868802329438080:12345-0@lo:104: Request processed in 32us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.858017:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782228893.858027:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782228893.858031:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:8309:x1868802329438208:12345-0@lo:104: 00010000:00010000:0.0:1782228893.858038:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858061:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1782228893.858065:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:8309:x1868802329438208:12345-0@lo:104: Request processed in 34us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.858071:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782228893.858081:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782228893.858086:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:8309:x1868802329438336:12345-0@lo:104: 00010000:00010000:0.0:1782228893.858092:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858113:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1782228893.858117:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:8309:x1868802329438336:12345-0@lo:104: Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.858122:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782228893.858131:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782228893.858136:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:8309:x1868802329438464:12345-0@lo:104: 00010000:00010000:0.0:1782228893.858142:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858161:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1782228893.858165:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:8309:x1868802329438464:12345-0@lo:104: Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.858176:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1782228893.858195:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1782228893.858201:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858209:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53378400 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228893.858214:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858224:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228893.858232:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228893.858238:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228893.858269:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858276:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228893.858296:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858303:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53378400/0x8e1c8a3488e636d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e636de expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858318:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782228893.858321:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858337:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53379c00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228893.858340:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858347:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228893.858354:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228893.858359:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228893.858381:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858388:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228893.858393:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858400:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53379c00/0x8e1c8a3488e636ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e636b4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858409:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782228893.858412:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858417:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82051c00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228893.858420:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858458:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228893.858465:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228893.858471:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782228893.858485:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858491:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228893.858509:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858515:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051c00/0x8e1c8a3488e63691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63698 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858524:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782228893.858527:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858532:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82050600 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228893.858534:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.858540:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228893.858546:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228893.858560:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1782228893.858729:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437696:0@lo:104: 00000100:00100000:1.0:1782228893.858739:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437824:0@lo:104: 00000100:00100000:1.0:1782228893.858746:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437952:0@lo:104: 00000100:00100000:1.0:1782228893.858753:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438080:0@lo:104: 00000100:00100000:1.0:1782228893.858760:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438208:0@lo:104: 00000100:00100000:1.0:1782228893.858766:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438336:0@lo:104: 00000100:00100000:1.0:1782228893.858773:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329438464:0@lo:104: 00000100:00100000:3.0:1782228893.858892:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782228893.858910:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329438848:0@lo:103: 00000100:00100000:3.0:1782228893.858953:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228893.859047:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438848 00000100:00100000:1.0:1782228893.859053:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438848 00010000:00010000:1.0:1782228893.859078:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 19 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228893.859110:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782228893.859116:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329438848:12345-0@lo:103: 00010000:00010000:1.0:1782228893.859138:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782228893.859145:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 19 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859156:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 19 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859172:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e63698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63691 expref: 19 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859186:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782228893.859212:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3311:x1868802329438848:12345-0@lo:103: Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228893.859218:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782228893.859278:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329438848:0@lo:103: 00010000:00010000:1.0:1782228893.859507:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782228893.859513:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859522:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82050e00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782228893.859526:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859535:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782228893.859541:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228893.859547:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782228893.859655:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859666:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782228893.859675:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859682:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e63675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6367c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859693:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782228893.859696:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859703:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53378200 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782228893.859706:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859713:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782228893.859717:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228893.859722:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782228893.859733:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859739:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782228893.859744:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859750:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53378200/0x8e1c8a3488e6364b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63652 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859764:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782228893.859767:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859773:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53378600 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782228893.859776:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859783:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782228893.859790:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228893.859793:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782228893.859804:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859809:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782228893.859814:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859821:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53378600/0x8e1c8a3488e63621 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63628 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.859828:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228893.859830:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228893.859832:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228893.859840:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228893.859918:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329438976:0@lo:103: 00000100:00100000:3.0:1782228893.859950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228893.859995:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438976 00000100:00100000:3.0:1782228893.860000:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438976 00010000:00010000:3.0:1782228893.860022:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 18 pid: 5790 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228893.860044:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782228893.860050:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3311:x1868802329438976:12345-0@lo:103: 00010000:00010000:3.0:1782228893.860060:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228893.860064:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 18 pid: 5790 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.860072:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 18 pid: 5790 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.860083:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53378c00/0x8e1c8a3488e6367c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63675 expref: 18 pid: 5790 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.860093:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228893.860121:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3311:x1868802329438976:12345-0@lo:103: Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228893.860127:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782228893.860155:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329438976:0@lo:103: 00010000:00010000:0.0:1782228893.860365:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.860382:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782228893.860415:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1782228893.860641:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.860650:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82050600/0x8e1c8a3488e63683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6368a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.860669:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228893.860671:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228893.860672:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228893.860688:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329438592:0@lo:103: 00000100:00100000:0.0:1782228893.860724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.860743:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329439104:0@lo:103: 00000100:00100000:0.0:1782228893.860764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.860787:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782228893.860792:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329438720:0@lo:103: 00000100:00100000:0.0:1782228893.860811:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.860825:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329439232:0@lo:103: 00000100:00100000:0.0:1782228893.860843:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.860893:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438592 00000100:00100000:0.0:1782228893.860898:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438592 00010000:00010000:0.0:1782228893.860921:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 17 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228893.860952:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329439104 00000100:00100000:0.0:1782228893.860955:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329439104 00010000:00010000:0.0:1782228893.860968:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228893.860978:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329438720 00000100:00100000:0.0:1782228893.860980:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329438720 00010000:00010000:0.0:1782228893.860990:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 19 pid: 5791 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228893.861000:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329439232 00000100:00100000:0.0:1782228893.861002:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329439232 00010000:00010000:0.0:1782228893.861012:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 20 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228893.861023:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782228893.861029:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+20:3308:x1868802329438592:12345-0@lo:103: 00010000:00010000:0.0:1782228893.861038:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228893.861042:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 20 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861051:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 20 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861064:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53378a00/0x8e1c8a3488e636de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e636d7 expref: 20 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861074:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228893.861100:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329438592:12345-0@lo:103: Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.861115:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782228893.861132:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782228893.861138:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3308:x1868802329439104:12345-0@lo:103: 00010000:00010000:0.0:1782228893.861146:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228893.861150:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861159:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861170:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e63652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e6364b expref: 18 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861178:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228893.861199:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3308:x1868802329439104:12345-0@lo:103: Request processed in 62us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.861205:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782228893.861216:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782228893.861222:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3308:x1868802329438720:12345-0@lo:103: 00010000:00010000:0.0:1782228893.861230:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228893.861234:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 16 pid: 5791 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861242:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 16 pid: 5791 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861252:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82051000/0x8e1c8a3488e636b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e636ad expref: 16 pid: 5791 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861269:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228893.861288:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:3308:x1868802329438720:12345-0@lo:103: Request processed in 67us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.861293:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782228893.861304:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782228893.861310:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3308:x1868802329439232:12345-0@lo:103: 00010000:00010000:0.0:1782228893.861319:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228893.861323:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 14 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861330:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 14 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861340:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53379400/0x8e1c8a3488e63628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63621 expref: 14 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.861347:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228893.861362:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:3308:x1868802329439232:12345-0@lo:103: Request processed in 53us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.861368:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782228893.861405:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329438720:0@lo:103: 00000100:00100000:0.0:1782228893.861412:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329439232:0@lo:103: 00000100:00100000:0.0:1782228893.861418:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329438592:0@lo:103: 00000100:00100000:0.0:1782228893.861424:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329439104:0@lo:103: 00000100:00100000:3.0:1782228893.861975:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329439360:0@lo:103: 00000100:00100000:3.0:1782228893.862017:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228893.862098:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329439360 00000100:00100000:0.0:1782228893.862109:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329439360 00010000:00010000:0.0:1782228893.862129:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 13 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228893.862199:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782228893.862207:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:3311:x1868802329439360:12345-0@lo:103: 00010000:00010000:0.0:1782228893.862216:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228893.862220:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 13 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.862228:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 13 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.862239:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e6368a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63683 expref: 13 pid: 5792 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.862251:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228893.862287:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:3311:x1868802329439360:12345-0@lo:103: Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.862293:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782228893.862380:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329439360:0@lo:103: 00000100:00100000:1.0:1782228893.869996:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437440:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782228893.870236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228893.870313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228893.874787:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492736 00000100:00100000:3.0:1782228893.874809:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492736 00010000:00010000:3.0:1782228893.874877:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 10 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228893.874923:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492864 00000100:00100000:3.0:1782228893.874926:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492864 00000100:00100000:0.0:1782228893.875030:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:0.0:1782228893.875047:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:2372:x1868802309492736:12345-192.168.204.22@tcp:103: 00010000:00010000:0.0:1782228893.875080:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228893.875089:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 11 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.875107:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 11 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.875150:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e636f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495e4 expref: 11 pid: 5790 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228893.875171:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228893.875262:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309492736:12345-192.168.204.22@tcp:103: Request processed in 220us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228893.875270:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:1.0:1782228893.875496:0:8309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8309:1868802329437568:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782228893.875565:0:8309:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.875862:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 9 pid: 5792 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228893.875896:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:3.0:1782228893.875905:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:2372:x1868802309492864:12345-192.168.204.22@tcp:103: 00010000:00010000:3.0:1782228893.875916:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228893.875921:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 9 pid: 5792 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.875933:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 9 pid: 5792 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876124:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53379e00/0x8e1c8a3488e636ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99495dd expref: 9 pid: 5792 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876140:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876150:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876168:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876186:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876194:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876202:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876208:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82050400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782228893.876213:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876222:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876245:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228893.876256:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228893.876340:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:2372:x1868802309492864:12345-192.168.204.22@tcp:103: Request processed in 435us (6026us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228893.876348:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 20 00010000:00010000:1.0:1782228893.876363:0:8309:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.876384:0:8309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228893.876391:0:8309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6372b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.081010:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228894.271088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228894.271281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228894.272497:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309493120 00000100:00100000:1.0:1782228894.272513:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309493120 00000100:00100000:1.0:1782228894.272625:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:1.0:1782228894.272638:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309493120:12345-192.168.204.22@tcp:400: 00000100:00100000:1.0:1782228894.272757:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309493120:12345-192.168.204.22@tcp:400: Request processed in 122us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.272766:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00080000:3.0:1782228894.273295:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228894.274416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228894.274533:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228894.275707:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309493248 00000100:00100000:1.0:1782228894.275723:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309493248 00000100:00100000:1.0:1782228894.275825:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309493376 00000100:00100000:1.0:1782228894.275830:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309493376 00000100:00100000:1.0:1782228894.275860:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:1.0:1782228894.275872:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309493248:12345-192.168.204.22@tcp:400: 00000100:00100000:1.0:1782228894.275989:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309493248:12345-192.168.204.22@tcp:400: Request processed in 120us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.276018:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:1.0:1782228894.276041:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:1.0:1782228894.276047:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309493376:12345-192.168.204.22@tcp:400: 00000100:00100000:1.0:1782228894.276074:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309493376:12345-192.168.204.22@tcp:400: Request processed in 27us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.276081:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00080000:0.0:1782228894.276716:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782228894.276723:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782228894.279992:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309492992 00000100:00100000:2.0:1782228894.280016:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309492992 00000100:00100000:2.0:1782228894.280166:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 129 00000100:00100000:2.0:1782228894.280179:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:2370:x1868802309492992:12345-192.168.204.22@tcp:400: 00000100:00100000:2.0:1782228894.283638:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:2370:x1868802309492992:12345-192.168.204.22@tcp:400: Request processed in 3438us (12544us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228894.283660:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 129 10000000:01000000:3.0:1782228894.908915:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782228894.908927:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe7fe6d000 from 39 10000000:01000000:3.0:1782228894.908935:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782228894.909020:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.909056:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.909071:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228894.909103:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329439488:0@lo:101: 00000100:00100000:3.0:1782228894.909202:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.909293:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92780 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.909867:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329439488 00000100:00100000:1.0:1782228894.909878:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329439488 00000100:00100000:1.0:1782228894.909959:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782228894.909970:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+12:5794:x1868802329439488:12345-0@lo:101: 00010000:00010000:1.0:1782228894.909988:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228894.910010:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82050800/0x8e1c8a3488e63739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63732 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.910043:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82050800/0x8e1c8a3488e63739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63732 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.910058:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82050800/0x8e1c8a3488e63739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63732 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.910068:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82050800, rc 0) 00000100:00100000:1.0:1782228894.910145:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329439488:12345-0@lo:101: Request processed in 177us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.910152:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782228894.912146:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329439488:0@lo:101: 00010000:00010000:3.0:1782228894.912185:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.912200:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228894.912314:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329439616:0@lo:501: 00000100:00100000:3.0:1782228894.912415:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.912611:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92780 going to sleep for 11 seconds 00000100:00100000:2.0:1782228894.913513:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329439616 00000100:00100000:2.0:1782228894.913525:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329439616 00000100:00100000:2.0:1782228894.913614:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782228894.913628:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329439616:12345-0@lo:501: 00000100:00100000:2.0:1782228894.914083:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329439616:12345-0@lo:501: Request processed in 456us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228894.914091:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782228894.914660:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329439616:0@lo:501: 00000100:00100000:3.0:1782228894.914750:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329439744:0@lo:503: 00000100:00100000:3.0:1782228894.914928:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.914979:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92780 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.915101:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329439744 00000100:00100000:0.0:1782228894.915108:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329439744 00000100:00100000:0.0:1782228894.915158:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782228894.915167:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329439744:12345-0@lo:503: 00000100:00100000:0.0:1782228894.915414:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329439744:12345-0@lo:503: Request processed in 246us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.915421:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782228894.915557:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329439744:0@lo:503: 00000100:00100000:2.0:1782228894.916052:0:8325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8325:1868802329439872:0@lo:502: 00000100:00100000:2.0:1782228894.916114:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228894.916152:0:8325:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.916207:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329439872 00000100:00100000:1.0:1782228894.916215:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329439872 00000100:00100000:1.0:1782228894.916257:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782228894.916273:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:8325:x1868802329439872:12345-0@lo:502: 00000100:00100000:1.0:1782228894.916866:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:8325:x1868802329439872:12345-0@lo:502: Request processed in 591us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.916874:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782228894.917208:0:8325:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8325:1868802329439872:0@lo:502: 00000100:00100000:2.0:1782228894.917270:0:8325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8325:1868802329440000:0@lo:502: 00000100:00100000:2.0:1782228894.917312:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228894.917364:0:8325:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.917425:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440000 00000100:00100000:0.0:1782228894.917461:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440000 00000100:00100000:0.0:1782228894.917516:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782228894.917526:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:8325:x1868802329440000:12345-0@lo:502: 00000100:00100000:0.0:1782228894.917731:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:8325:x1868802329440000:12345-0@lo:502: Request processed in 206us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.917748:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782228894.918199:0:8325:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8325:1868802329440000:0@lo:502: 00000040:00080000:2.0:1782228894.918233:0:8325:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782228894.925206:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782228894.925286:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782228894.925303:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.925317:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228894.925329:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782228894.925333:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1782228894.925336:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782228894.925407:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.925416:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.926198:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228894.926242:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440128:0@lo:101: 00000100:00100000:3.0:1782228894.926343:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.926518:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92780 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.929176:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440128 00000100:00100000:1.0:1782228894.929197:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440128 00000100:00100000:1.0:1782228894.929896:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782228894.929915:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+13:5794:x1868802329440128:12345-0@lo:101: 00010000:00010000:1.0:1782228894.929942:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228894.929970:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82051e00/0x8e1c8a3488e63747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63740 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.930023:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82051e00/0x8e1c8a3488e63747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63740 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.930037:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82051e00/0x8e1c8a3488e63747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63740 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.930050:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051e00, rc 0) 00000100:00100000:1.0:1782228894.930160:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329440128:12345-0@lo:101: Request processed in 251us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.930168:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782228894.930299:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440128:0@lo:101: 00010000:00010000:3.0:1782228894.930324:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.930335:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228894.930481:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440256:0@lo:501: 00000100:00100000:3.0:1782228894.930550:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.931080:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92780 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.931153:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440256 00000100:00100000:0.0:1782228894.931162:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440256 00000100:00100000:0.0:1782228894.931206:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782228894.931213:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329440256:12345-0@lo:501: 00000100:00100000:0.0:1782228894.931622:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329440256:12345-0@lo:501: Request processed in 407us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.931630:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782228894.931693:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440256:0@lo:501: 00000100:00100000:0.0:1782228894.931750:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440384:0@lo:503: 00000100:00100000:0.0:1782228894.931801:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228894.931817:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc0300 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.931831:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440384 00000100:00100000:0.0:1782228894.931835:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440384 00000100:00100000:0.0:1782228894.931854:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782228894.931860:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329440384:12345-0@lo:503: 00000100:00100000:0.0:1782228894.932380:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329440384:12345-0@lo:503: Request processed in 517us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.932388:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782228894.932687:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440384:0@lo:503: 00000100:00100000:1.0:1782228894.933408:0:8326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8326:1868802329440512:0@lo:502: 00000100:00100000:1.0:1782228894.933669:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.933750:0:8326:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898900 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.933795:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440512 00000100:00100000:0.0:1782228894.933803:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440512 00000100:00100000:0.0:1782228894.933890:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782228894.933900:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:8326:x1868802329440512:12345-0@lo:502: 00000100:00100000:0.0:1782228894.936778:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:8326:x1868802329440512:12345-0@lo:502: Request processed in 2863us (3092us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.936818:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782228894.939963:0:8326:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8326:1868802329440512:0@lo:502: 00000020:01000000:2.0:1782228894.940237:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228894.940256:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228894.940259:0:8326:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782228894.940270:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782228894.940327:0:8326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8326:1868802329440640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228894.945527:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228894.945726:0:8326:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c501300 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.945836:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440640 00000100:00100000:1.0:1782228894.945848:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440640 00000100:00100000:1.0:1782228894.945964:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782228894.946005:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:8326:x1868802329440640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.946368:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:8326:x1868802329440640:12345-0@lo:502:llog_process_th.0 Request processed in 364us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.946377:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782228894.946526:0:8326:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8326:1868802329440640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228894.946567:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228894.946583:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228894.946586:0:8326:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782228894.946594:0:8326:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1782228894.946988:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1782228894.947020:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782228894.947034:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.947047:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228894.947058:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782228894.947061:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe7b8d6000 from 39 10000000:01000000:0.0:1782228894.947063:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782228894.947103:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.947111:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.947122:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228894.947149:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.947204:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228894.947619:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc0840 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.947764:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440768 00000100:00100000:3.0:1782228894.947773:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440768 00000100:00100000:3.0:1782228894.947823:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782228894.947833:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:5794:x1868802329440768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228894.947852:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228894.947868:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916200/0x8e1c8a3488e63755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6374e expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.947900:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916200/0x8e1c8a3488e63755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6374e expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.947913:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916200/0x8e1c8a3488e63755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6374e expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.947924:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916200, rc 0) 00000100:00100000:3.0:1782228894.948157:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329440768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.948165:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782228894.948270:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228894.948287:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.948298:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228894.950764:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.950861:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228894.950911:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.953194:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329440896 00000100:00100000:0.0:1782228894.953217:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329440896 00000100:00100000:0.0:1782228894.953313:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782228894.953327:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329440896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.954188:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329440896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 858us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.954200:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782228894.954745:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329440896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.954912:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.955051:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228894.955194:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228894.955249:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441024 00000100:00100000:2.0:1782228894.955256:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441024 00000100:00100000:0.0:1782228894.955421:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782228894.955457:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329441024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.955823:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329441024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 393us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.955831:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782228894.955931:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.956520:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8327:1868802329441152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.956573:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.956863:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898180 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.956920:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441152 00000100:00100000:3.0:1782228894.956927:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441152 00000100:00100000:3.0:1782228894.956961:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782228894.957038:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:8327:x1868802329441152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228894.957378:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:8327:x1868802329441152:12345-0@lo:502:llog_process_th.0 Request processed in 408us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.957387:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782228894.957567:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8327:1868802329441152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.957624:0:8327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8327:1868802329441280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.957662:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.957691:0:8327:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898180 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.960875:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441280 00000100:00100000:3.0:1782228894.960921:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441280 00000100:00100000:3.0:1782228894.961001:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782228894.961012:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:8327:x1868802329441280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228894.961422:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:8327:x1868802329441280:12345-0@lo:502:llog_process_th.0 Request processed in 411us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.961452:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782228894.962624:0:8327:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8327:1868802329441280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782228894.962679:0:8327:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782228894.963029:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782228894.963067:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782228894.963157:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.963171:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228894.963183:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782228894.963187:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782228894.963190:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782228894.963238:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.963248:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.963259:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228894.963288:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782228894.963382:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.963460:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.963591:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441408 00000100:00100000:0.0:1782228894.963599:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441408 00000100:00100000:0.0:1782228894.963650:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782228894.963659:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:5794:x1868802329441408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228894.963686:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228894.963703:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40031000/0x8e1c8a3488e63763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6375c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.963736:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40031000/0x8e1c8a3488e63763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6375c expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.963750:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40031000/0x8e1c8a3488e63763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6375c expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.963761:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031000, rc 0) 00000100:00100000:0.0:1782228894.963802:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329441408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.963811:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782228894.964020:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228894.964037:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228894.964047:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228894.964202:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228894.964236:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.964271:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.964710:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441536 00000100:00100000:0.0:1782228894.964717:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441536 00000100:00100000:0.0:1782228894.964765:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782228894.964775:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329441536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.965324:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329441536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 548us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.965336:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782228894.965602:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228894.965665:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228894.965721:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228894.965804:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228894.965980:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441664 00000100:00100000:2.0:1782228894.965987:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441664 00000100:00100000:1.0:1782228894.966174:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782228894.966187:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329441664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.966594:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329441664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 409us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.966603:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782228894.966795:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329441664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228894.967060:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8328:1868802329441792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228894.967289:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228894.967330:0:8328:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.967390:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441792 00000100:00100000:1.0:1782228894.967397:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441792 00000100:00100000:1.0:1782228894.967460:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782228894.967629:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:8328:x1868802329441792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.967858:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:8328:x1868802329441792:12345-0@lo:502:llog_process_th.0 Request processed in 231us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228894.967958:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8328:1868802329441792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228894.967994:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228894.968006:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228894.968009:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782228894.968017:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782228894.968049:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8328:1868802329441920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228894.968106:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228894.968123:0:8328:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.968318:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329441920 00000100:00100000:3.0:1782228894.968324:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329441920 00000100:00100000:1.0:1782228894.968419:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782228894.969264:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782228894.969280:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:8328:x1868802329441920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228894.969732:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:8328:x1868802329441920:12345-0@lo:502:llog_process_th.0 Request processed in 456us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.969741:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782228894.969835:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8328:1868802329441920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228894.969876:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228894.969884:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228894.969886:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782228894.969894:0:8328:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1782228894.970274:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1782228894.970298:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782228894.970314:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.970327:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228894.970340:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782228894.970343:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe50300000 from 39 10000000:01000000:1.0:1782228894.970346:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782228894.970400:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.970409:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.970419:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228894.970487:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.970550:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.970867:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898540 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.970944:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442048 00000100:00100000:0.0:1782228894.970953:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442048 00000100:00100000:0.0:1782228894.971012:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782228894.971023:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329442048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228894.971038:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228894.971056:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e63771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6376a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.971244:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e63771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6376a expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.971257:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e63771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6376a expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.971268:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031400, rc 0) 00000100:00100000:0.0:1782228894.971325:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329442048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 303us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.971332:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782228894.971532:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782228894.971552:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.971561:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228894.971638:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.971667:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.971682:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898540 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.971752:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442176 00000100:00100000:0.0:1782228894.971756:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442176 00000100:00100000:0.0:1782228894.971775:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782228894.971780:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329442176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.972229:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329442176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.972238:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782228894.972346:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.972395:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.972551:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.972582:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898540 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.972654:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442304 00000100:00100000:0.0:1782228894.972661:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442304 00000100:00100000:0.0:1782228894.972684:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782228894.972690:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329442304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228894.972866:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329442304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228894.972872:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782228894.972948:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.973607:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8329:1868802329442432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.973652:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.973677:0:8329:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898180 going to sleep for 11 seconds 00000100:00100000:0.0:1782228894.973741:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442432 00000100:00100000:0.0:1782228894.973747:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442432 00000100:00100000:0.0:1782228894.973786:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782228894.973794:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8329:x1868802329442432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.974421:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8329:x1868802329442432:12345-0@lo:502:llog_process_th.0 Request processed in 624us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.974450:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782228894.974633:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8329:1868802329442432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228894.974698:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8329:1868802329442560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228894.974740:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228894.974756:0:8329:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898180 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.974927:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442560 00000100:00100000:3.0:1782228894.974934:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442560 00000100:00100000:3.0:1782228894.975161:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782228894.975171:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8329:x1868802329442560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228894.977758:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8329:x1868802329442560:12345-0@lo:502:llog_process_th.0 Request processed in 2572us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.977799:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782228894.977964:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8329:1868802329442560:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782228894.978037:0:8329:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782228894.978482:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782228894.978506:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782228894.978519:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228894.978540:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782228894.978553:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782228894.978556:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1782228894.978560:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782228894.978604:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228894.978613:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228894.978624:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228894.978650:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782228894.978722:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228894.980373:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.980456:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442688 00000100:00100000:1.0:1782228894.980661:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442688 00000100:00100000:1.0:1782228894.980729:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782228894.980738:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329442688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782228894.980758:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228894.980780:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6377f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63778 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.980815:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6377f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63778 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.980848:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6377f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63778 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.980859:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82050400, rc 0) 00000100:00100000:1.0:1782228894.980939:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329442688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.980946:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782228894.981328:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228894.981362:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228894.981372:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228894.981815:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228894.981869:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228894.981900:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.982053:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442816 00000100:00100000:3.0:1782228894.982062:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442816 00000100:00100000:3.0:1782228894.982177:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782228894.982186:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329442816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228894.982702:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329442816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 516us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.982711:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782228894.982805:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228894.982856:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228894.982901:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228894.982934:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.983055:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329442944 00000100:00100000:3.0:1782228894.983060:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329442944 00000100:00100000:3.0:1782228894.983154:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782228894.983161:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329442944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228894.983374:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329442944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.983381:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782228894.983774:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329442944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.984368:0:8330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a29180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8330:1868802329443072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.984427:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.984728:0:8330:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228894.984773:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443072 00000100:00100000:3.0:1782228894.984780:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443072 00000100:00100000:3.0:1782228894.984853:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782228894.984861:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8330:x1868802329443072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228894.985290:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8330:x1868802329443072:12345-0@lo:502:llog_process_th.0 Request processed in 427us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228894.985298:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782228894.985395:0:8330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a29180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8330:1868802329443072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782228894.985471:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782228894.985485:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228894.985487:0:8330:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782228894.985495:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782228894.985530:0:8330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8330:1868802329443200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228894.985575:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228894.985865:0:8330:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43898180 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.985931:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443200 00000100:00100000:1.0:1782228894.985937:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443200 00000100:00100000:1.0:1782228894.985968:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782228894.985982:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8330:x1868802329443200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228894.986204:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8330:x1868802329443200:12345-0@lo:502:llog_process_th.0 Request processed in 222us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.986211:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782228894.988380:0:8330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8330:1868802329443200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782228894.988474:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782228894.988489:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782228894.988491:0:8330:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782228894.988498:0:8330:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782228894.988845:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1782228894.988876:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782228894.988890:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.988902:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228894.988915:0:5794:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782228894.988930:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff98fe68ea3380 from 1 10000000:01000000:1.0:1782228894.988934:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782228894.988978:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.988999:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.989009:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228894.989037:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329443328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.989255:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.989301:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.989332:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443328 00000100:00100000:1.0:1782228894.989338:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443328 00000100:00100000:1.0:1782228894.989394:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782228894.989404:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329443328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782228894.989422:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228894.989527:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e6378d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63786 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.989563:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e6378d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63786 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.989574:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e6378d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63786 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.989585:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051600, rc 0) 00000100:00100000:1.0:1782228894.989629:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329443328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228894.989646:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782228894.989697:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329443328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782228894.989713:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6378d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228894.989723:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6378d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228894.989780:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329443456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.989808:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228894.989824:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228894.989838:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443456 00000100:00100000:1.0:1782228894.989841:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443456 00000100:00100000:1.0:1782228894.989859:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782228894.989864:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329443456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228894.993410:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329443456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3531us (3587us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782228894.993458:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782228894.993761:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329443456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782228894.993815:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782228894.993828:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6378d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228894.993856:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6378d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228895.101852:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228896.128693:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228897.148751:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228897.404351:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782228897.404379:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329443584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228897.404478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228897.404865:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329443968:0@lo:400:kworker.0 00000100:00100000:2.0:1782228897.404900:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228897.404922:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782228897.404928:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329444096:0@lo:400:kworker.0 00000100:00100000:2.0:1782228897.404954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228897.405027:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329443840:0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.405059:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228897.405090:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782228897.405119:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329443712:0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.405152:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228897.405175:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329444224:0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.405198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228897.405226:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443968 00000100:00100000:3.0:1782228897.405233:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443968 00000100:00100000:3.0:1782228897.405292:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443840 00000100:00100000:3.0:1782228897.405295:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443840 00000100:00100000:3.0:1782228897.405326:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329444224 00000100:00100000:3.0:1782228897.405329:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329444224 00000100:00100000:3.0:1782228897.405344:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782228897.405352:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329443968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.405408:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329443968:12345-0@lo:400:kworker.0 Request processed in 56us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228897.405414:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782228897.405455:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782228897.405462:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329443840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.405496:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329443840:12345-0@lo:400:kworker.0 Request processed in 34us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228897.406038:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782228897.406057:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782228897.406065:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329444224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.406101:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329444224:12345-0@lo:400:kworker.0 Request processed in 38us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228897.406107:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1782228897.406128:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228897.406165:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329444224:0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.406191:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329443840:0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.406224:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329443968:0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.406244:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443712 00000100:00100000:3.0:1782228897.406248:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443712 00000100:00100000:3.0:1782228897.406276:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782228897.406282:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329443712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228897.406329:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329443712:12345-0@lo:400:kworker.0 Request processed in 47us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228897.406335:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782228897.406368:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329443712:0@lo:400:kworker.0 00000100:00100000:1.0:1782228897.406463:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329443584 00000100:00100000:1.0:1782228897.406469:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329443584 00000100:00100000:1.0:1782228897.406524:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782228897.406532:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329443584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228897.406688:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228897.406732:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329443584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228897.406750:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782228897.406778:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329444096 00000100:00100000:1.0:1782228897.406782:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329444096 00000100:00100000:1.0:1782228897.406809:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782228897.406816:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329444096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228897.406850:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329444096:12345-0@lo:400:kworker.0 Request processed in 34us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228897.406855:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1782228897.406977:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228897.406981:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782228897.407003:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e7bb80 x1868802329444096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228897.407014:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329444096:0@lo:400:kworker.0 00010000:00080000:3.0:1782228897.407024:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77a29880 x1868802329443584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228897.407037:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329443584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228897.917163:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782228897.917188:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329444352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782228897.917258:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228897.917750:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329444352 00000100:00100000:1.0:1782228897.917758:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329444352 00000100:00100000:1.0:1782228897.917806:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782228897.917816:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329444352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782228897.917855:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228897.917907:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329444352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228897.917914:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1782228897.917955:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c0b480 x1868802329444352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228897.917971:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329444352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782228898.172538:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228899.195734:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228899.401484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228899.401527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228899.401558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228899.401583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228899.401613:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309493760 00000100:00100000:1.0:1782228899.401624:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309493760 00000100:00100000:1.0:1782228899.401693:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309493888 00000100:00100000:1.0:1782228899.401696:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309493888 00000100:00100000:1.0:1782228899.401714:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:1.0:1782228899.401722:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309493760:12345-192.168.204.22@tcp:400: 00000100:00100000:1.0:1782228899.401800:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309493760:12345-192.168.204.22@tcp:400: Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228899.401807:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:1.0:1782228899.401826:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:1.0:1782228899.401832:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309493888:12345-192.168.204.22@tcp:400: 00000100:00100000:1.0:1782228899.401857:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309493888:12345-192.168.204.22@tcp:400: Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228899.401864:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:2.0:1782228899.402466:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309493504 00000100:00100000:2.0:1782228899.402471:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309493504 00000100:00100000:2.0:1782228899.402516:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 163 00000100:00100000:2.0:1782228899.402525:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:2372:x1868802309493504:12345-192.168.204.22@tcp:400: 00000100:00100000:2.0:1782228899.402565:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:2372:x1868802309493504:12345-192.168.204.22@tcp:400: Request processed in 41us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228899.402571:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 163 00000100:00100000:3.0:1782228899.402771:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309493632 00000100:00100000:3.0:1782228899.402776:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309493632 00000100:00100000:3.0:1782228899.402819:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:3.0:1782228899.402826:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309493632:12345-192.168.204.22@tcp:400: 00000100:00100000:3.0:1782228899.402858:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309493632:12345-192.168.204.22@tcp:400: Request processed in 33us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228899.402875:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00080000:3.0:1782228899.402891:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782228899.402895:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782228899.402897:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782228899.901866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228899.902022:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494016 00000100:00100000:2.0:1782228899.902033:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494016 00000100:00100000:2.0:1782228899.902096:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 164 00000100:00100000:2.0:1782228899.902107:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:5586:x1868802309494016:12345-192.168.204.22@tcp:101: 00010000:00010000:2.0:1782228899.902125:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228899.902144:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e63794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949646 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228899.902174:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e63794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949646 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228899.902201:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e63794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949646 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228899.902211:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b2600, rc 0) 00000100:00100000:2.0:1782228899.902274:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5586:x1868802309494016:12345-192.168.204.22@tcp:101: Request processed in 170us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228899.902281:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 164 00000100:00100000:3.0:1782228899.905954:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228899.907934:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494144 00000100:00100000:1.0:1782228899.907948:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494144 00000100:00100000:1.0:1782228899.908022:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 165 00000100:00100000:1.0:1782228899.908032:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5586:x1868802309494144:12345-192.168.204.22@tcp:501: 00000100:00100000:1.0:1782228899.908359:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5586:x1868802309494144:12345-192.168.204.22@tcp:501: Request processed in 327us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228899.908368:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 165 00000100:00100000:1.0:1782228899.911666:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228899.911759:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494272 00000100:00100000:0.0:1782228899.911768:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494272 00000100:00100000:0.0:1782228899.911825:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 166 00000100:00100000:0.0:1782228899.911837:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5586:x1868802309494272:12345-192.168.204.22@tcp:503: 00000100:00100000:0.0:1782228899.912062:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5586:x1868802309494272:12345-192.168.204.22@tcp:503: Request processed in 227us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228899.912070:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 166 00000100:00100000:0.0:1782228899.922662:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228899.925644:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494400 00000100:00100000:2.0:1782228899.925661:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494400 00000100:00100000:2.0:1782228899.925740:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 167 00000100:00100000:2.0:1782228899.925751:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:6081:x1868802309494400:12345-192.168.204.22@tcp:502: 00000100:00100000:2.0:1782228899.926124:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:6081:x1868802309494400:12345-192.168.204.22@tcp:502: Request processed in 374us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228899.926132:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 167 00000100:00100000:3.0:1782228899.932608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228899.933168:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494528 00000100:00100000:1.0:1782228899.933178:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494528 00000100:00100000:1.0:1782228899.933241:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 168 00000100:00100000:1.0:1782228899.933264:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:6081:x1868802309494528:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782228899.933593:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:6081:x1868802309494528:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 341us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228899.933608:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 168 00000100:00100000:1.0:1782228899.936835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228899.945888:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494656 00000100:00100000:0.0:1782228899.945906:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494656 00000100:00100000:0.0:1782228899.946063:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 169 00000100:00100000:0.0:1782228899.946075:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5586:x1868802309494656:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228899.946093:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228899.946116:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6379b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994964d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228899.946165:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6379b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994964d expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228899.946176:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6379b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994964d expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228899.946186:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030000, rc 0) 00000100:00100000:0.0:1782228899.946275:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309494656:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 203us (9449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228899.946283:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 169 00000100:00100000:0.0:1782228899.951496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228899.951617:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494784 00000100:00100000:2.0:1782228899.951631:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494784 00000100:00100000:2.0:1782228899.951715:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 170 00000100:00100000:2.0:1782228899.951728:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309494784:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228899.952141:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309494784:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 414us (710us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782228899.952149:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 170 00010000:00010000:0.0:1782228900.219951:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228901.243649:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782228901.577628:0:8370:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeed11240 20000000:00000080:1.0:1782228901.577648:0:8370:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fe779b7800 uarg=0000000000000000 20000000:01000000:1.0:1782228901.577687:0:8370:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782228901.577693:0:8370:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782228901.577697:0:8370:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782228901.581297:0:8371:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1782228901.581852:0:8370:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1782228901.590978:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1782228901.591056:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1782228901.591125:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1782228901.591146:0:8370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782228901.591167:0:8370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591186:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53379200/0x8e1c8a3488e63517 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591194:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591201:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591212:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591232:0:8370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591299:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591319:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 9 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228901.591336:0:8370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444480:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782228901.591821:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591831:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 18 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228901.591841:0:8370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444608:0@lo:104: 00000100:00100000:1.0:1782228901.591889:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228901.591936:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.591945:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 18 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228901.591948:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329444608 00000100:00100000:1.0:1782228901.591955:0:8370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444736:0@lo:104: 00000100:00100000:2.0:1782228901.591958:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329444608 00000100:00100000:1.0:1782228901.591982:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228901.592004:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe53379200/0x8e1c8a3488e63517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228901.592009:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1782228901.592013:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe53379200/0x8e1c8a3488e63517 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 18 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228901.592032:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329444736 00000100:00100000:2.0:1782228901.592037:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329444736 00000100:00100000:1.0:1782228901.592040:0:8370:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444864:0@lo:104: 00000100:00100000:2.0:1782228901.592058:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782228901.592070:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:8370:x1868802329444608:12345-0@lo:104: 00000100:00100000:1.0:1782228901.592070:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228901.592083:0:8370:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e000 going to sleep for 11 seconds 00010000:00010000:2.0:1782228901.592098:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.592174:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782228901.592180:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:8370:x1868802329444608:12345-0@lo:104: Request processed in 115us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228901.592186:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782228901.592202:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329444864 00000100:00100000:2.0:1782228901.592206:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329444864 00000100:00100000:2.0:1782228901.592237:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782228901.592243:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74551c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:8370:x1868802329444736:12345-0@lo:104: 00010000:00010000:0.0:1782228901.592249:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782228901.592252:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.592259:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.592269:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031800 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228901.592275:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.592296:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782228901.592302:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74551c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:8370:x1868802329444736:12345-0@lo:104: Request processed in 59us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228901.592320:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782228901.592351:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1782228901.592352:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228901.592362:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:8370:x1868802329444864:12345-0@lo:104: 10000000:00010000:0.0:1782228901.592365:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.592371:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228901.592374:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782228901.592413:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782228901.592424:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:8370:x1868802329444864:12345-0@lo:104: Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228901.592457:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1782228901.592904:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.592913:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782228901.592932:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.592939:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe40031800/0x8e1c8a3488e6363d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63644 expref: -99 pid: 7493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.592953:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782228901.592956:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.592962:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe605b2200 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:3.0:1782228901.592966:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.592974:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782228901.592980:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228901.592996:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782228901.593010:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593016:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782228901.593022:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593029:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe605b2200/0x8e1c8a3488e63572 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63579 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593038:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782228901.593041:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593045:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe605b3c00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:3.0:1782228901.593048:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593054:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782228901.593059:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228901.593064:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782228901.593075:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593080:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782228901.593103:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593109:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e63510 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63517 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228901.593122:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228901.593124:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228901.593195:0:8370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444608:0@lo:104: 00000100:00100000:1.0:1782228901.593205:0:8370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444736:0@lo:104: 00000100:00100000:1.0:1782228901.593212:0:8370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444864:0@lo:104: 00010000:00010000:0.0:1782228901.595932:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228901.596014:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329445248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782228901.596088:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228901.596167:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329445120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782228901.596205:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228901.596247:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329445248 00000100:00100000:1.0:1782228901.596255:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329445248 00010000:00010000:1.0:1782228901.596299:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53379200/0x8e1c8a3488e63517 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228901.596335:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782228901.596343:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329445248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782228901.596358:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782228901.596363:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53379200/0x8e1c8a3488e63517 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.596374:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53379200/0x8e1c8a3488e63517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.596392:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53379200/0x8e1c8a3488e63517 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63510 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.596409:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782228901.596489:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3308:x1868802329445248:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228901.596496:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782228901.596756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228901.596801:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782228901.596807:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329444992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782228901.596832:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228901.596875:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329445248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782228901.597011:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329445120 00000100:00100000:0.0:1782228901.597016:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329445120 00010000:00010000:0.0:1782228901.597033:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 18 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228901.597045:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329444992 00000100:00100000:0.0:1782228901.597048:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329444992 00010000:00010000:0.0:1782228901.597057:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 19 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228901.597068:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782228901.597074:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329445120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782228901.597082:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228901.597086:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.597093:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.597102:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40031600/0x8e1c8a3488e63579 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63572 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.597120:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228901.597148:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3311:x1868802329445120:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228901.597154:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782228901.597168:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782228901.597173:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3311:x1868802329444992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782228901.597180:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228901.597184:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 17 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.597191:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 17 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.597200:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53379000/0x8e1c8a3488e63644 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e6363d expref: 17 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228901.597207:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228901.597240:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3311:x1868802329444992:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228901.597246:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782228901.597269:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329444992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782228901.597277:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329445120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782228901.599030:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228901.600864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228901.600935:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309494912 00000100:00100000:2.0:1782228901.600945:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309494912 00010000:00010000:2.0:1782228901.600991:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228901.601044:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:2.0:1782228901.601054:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2373:x1868802309494912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782228901.601070:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782228901.601077:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228901.601092:0:8370:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1868802329444480:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782228901.601094:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.601118:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53378800/0x8e1c8a3488e63701 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949615 expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.601131:0:8370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.601134:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.601153:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.609976:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.613185:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.613238:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.613246:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.613251:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82050200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782228901.613255:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.613264:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.618915:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.618915:0:8370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.618943:0:8370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228901.618952:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82050200/0x8e1c8a3488e637a2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228901.618957:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782228901.619569:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:2373:x1868802309494912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 18509us (18707us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228901.619717:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 24 00010000:00010000:0.0:1782228902.268951:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228902.526653:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329445376:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.526729:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228902.526815:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329445888:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.526845:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228902.526873:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782228902.526879:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329445760:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.526906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228902.526934:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329445504:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.526957:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228902.526978:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329446016:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.526998:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228902.527012:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782228902.527017:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329445632:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.527035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228902.527067:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329445376 00000100:00100000:0.0:1782228902.527074:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329445376 00000100:00100000:0.0:1782228902.527117:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782228902.527126:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3309:x1868802329445376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.527174:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3309:x1868802329445376:12345-0@lo:400:kworker.0 Request processed in 50us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228902.527181:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782228902.527239:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329445888 00000100:00100000:0.0:1782228902.527243:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329445888 00000100:00100000:0.0:1782228902.527272:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329445504 00000100:00100000:0.0:1782228902.527275:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329445504 00000100:00100000:0.0:1782228902.527299:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329445632 00000100:00100000:0.0:1782228902.527301:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329445632 00000100:00100000:0.0:1782228902.527316:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782228902.527321:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329445888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.527363:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329445888:12345-0@lo:400:kworker.0 Request processed in 41us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228902.527369:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782228902.527526:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782228902.527535:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329445504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228902.527573:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329445504:12345-0@lo:400:kworker.0 Request processed in 39us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228902.527578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782228902.527589:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782228902.527595:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329445632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228902.527618:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329445632:12345-0@lo:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228902.527623:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1782228902.527650:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228902.527675:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329445376:0@lo:400:kworker.0 00000100:00100000:3.0:1782228902.527688:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329445888:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.527921:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329445632:0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.527931:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329445504:0@lo:400:kworker.0 00000100:00100000:1.0:1782228902.528505:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329445760 00000100:00100000:1.0:1782228902.528511:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329445760 00000100:00100000:0.0:1782228902.528542:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329446144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228902.528556:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446016 00000100:00100000:1.0:1782228902.528559:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446016 00000100:00100000:1.0:1782228902.528573:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782228902.528579:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329445760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228902.528582:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228902.528617:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329445760:12345-0@lo:400:kworker.0 Request processed in 38us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228902.528623:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782228902.528628:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782228902.528635:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329446016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228902.528641:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446144 00000100:00100000:1.0:1782228902.528643:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446144 00000100:00100000:1.0:1782228902.528664:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782228902.528665:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329446016:12345-0@lo:400:kworker.0 Request processed in 31us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228902.528669:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329446144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228902.528671:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1782228902.528689:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782228902.528692:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782228902.528696:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1782228902.528717:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c0b480 x1868802329445760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228902.528726:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329446144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228902.528728:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329445760:0@lo:400:kworker.0 00000100:00100000:1.0:1782228902.528745:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1782228902.528764:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77a29f80 x1868802329446144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228902.528777:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329446144:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1782228902.528892:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c0b800 x1868802329446016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228902.528901:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329446016:0@lo:400:kworker.0 00000100:00100000:0.0:1782228903.035918:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782228903.035940:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329446272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782228903.036007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228903.036095:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446272 00000100:00100000:0.0:1782228903.036102:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446272 00000100:00100000:0.0:1782228903.036147:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782228903.036157:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329446272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782228903.036203:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228903.036246:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329446272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228903.036252:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1782228903.036292:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c4380 x1868802329446272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228903.036309:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329446272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228903.044280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228903.044391:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495040 00000100:00100000:2.0:1782228903.044410:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495040 00000100:00100000:2.0:1782228903.044493:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 172 00000100:00100000:2.0:1782228903.044503:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+9:5586:x1868802309495040:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228903.044531:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228903.044549:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949654 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.044584:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.044601:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.044611:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b3a00, rc 0) 00000100:00100000:2.0:1782228903.045884:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309495040:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 1375us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228903.045894:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 172 00000100:00100000:1.0:1782228903.052094:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228903.052230:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495168 00000100:00100000:3.0:1782228903.052240:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495168 00000100:00100000:3.0:1782228903.052302:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 173 00000100:00100000:3.0:1782228903.052314:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309495168:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.052744:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309495168:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 432us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.052753:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 173 00000100:00100000:2.0:1782228903.057882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228903.058575:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495296 00000100:00100000:1.0:1782228903.058586:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495296 00000100:00100000:1.0:1782228903.058657:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 174 00000100:00100000:1.0:1782228903.058668:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309495296:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228903.058899:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:5586:x1868802309495296:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 Request processed in 232us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228903.058907:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 174 00000100:00100000:3.0:1782228903.069979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228903.070059:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495424 00000100:00100000:1.0:1782228903.070069:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495424 00000100:00100000:1.0:1782228903.070130:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 175 00000100:00100000:1.0:1782228903.070141:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:6139:x1868802309495424:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782228903.070423:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:6139:x1868802309495424:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 283us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228903.070456:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 175 00000100:00100000:0.0:1782228903.088501:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228903.089637:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495552 00000100:00100000:3.0:1782228903.089650:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495552 00000100:00100000:3.0:1782228903.089712:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 176 00000100:00100000:3.0:1782228903.089722:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:6139:x1868802309495552:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782228903.089957:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:6139:x1868802309495552:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 237us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.089965:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 176 00010000:00010000:2.0:1782228903.291977:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782228903.547505:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782228903.547515:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7fe6d000 from 4 10000000:01000000:1.0:1782228903.547519:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782228903.547573:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228903.547585:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228903.547597:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228903.547649:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329446400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782228903.547729:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.547789:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446400 00000100:00100000:3.0:1782228903.547797:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446400 00000100:00100000:1.0:1782228903.547809:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228903.548083:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782228903.548095:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329446400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228903.548111:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228903.548125:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e637b0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.548153:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.548164:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.548192:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917800, rc 0) 00000100:00100000:3.0:1782228903.548244:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329446400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.548251:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782228903.548357:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329446400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228903.548373:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.548382:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228903.548458:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.548487:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228903.555614:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782228903.556711:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446528 00000100:00100000:1.0:1782228903.556723:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446528 00000100:00100000:2.0:1782228903.557439:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782228903.557455:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329446528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.557730:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329446528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (9241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228903.557737:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782228903.558141:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329446528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.558218:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.558597:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228903.558671:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782228903.559079:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446656 00000100:00100000:1.0:1782228903.559087:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446656 00000100:00100000:3.0:1782228903.570413:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782228903.570570:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329446656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.570837:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329446656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 410us (12239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.570846:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782228903.570948:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329446656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.572892:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8439:1868802329446784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228903.572966:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.572999:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446784 00000100:00100000:3.0:1782228903.573007:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446784 00000100:00100000:3.0:1782228903.573042:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782228903.573049:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8439:x1868802329446784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228903.573245:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8439:x1868802329446784:12345-0@lo:502:llog_process_th.0 Request processed in 195us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.573253:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782228903.573451:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe59e43300 going to sleep for 11 seconds 00000100:00100000:3.0:1782228903.573472:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8439:1868802329446784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782228903.573502:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782228903.573513:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228903.573523:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782228903.573532:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe7fe6d000 00000020:00000080:3.0:1782228903.573534:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782228903.582380:0:8439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8439:1868802329446912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228903.582497:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228903.582540:0:8439:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228903.585455:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329446912 00000100:00100000:3.0:1782228903.585474:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329446912 00000100:00100000:3.0:1782228903.585527:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782228903.585537:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8439:x1868802329446912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228903.591092:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:8439:x1868802329446912:12345-0@lo:502:llog_process_th.0 Request processed in 5546us (8585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.591106:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782228903.591240:0:8439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8439:1868802329446912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782228903.593031:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782228903.593043:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228903.593045:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782228903.593052:0:8439:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782228903.593197:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782228903.593217:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782228903.593229:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.593240:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782228903.593250:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782228903.593253:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7b8d6000 from 4 10000000:01000000:3.0:1782228903.593256:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782228903.594392:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.594407:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.594427:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228903.594492:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.594560:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.594601:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228903.594644:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447040 00000100:00100000:3.0:1782228903.594651:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447040 00000100:00100000:3.0:1782228903.594704:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782228903.594713:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329447040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228903.594727:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228903.594739:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e637be expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.598616:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.598637:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.598648:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916a00, rc 0) 00000100:00100000:3.0:1782228903.598724:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329447040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4011us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.598733:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782228903.598818:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228903.598836:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228903.598854:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228903.598925:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.598956:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.598984:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228903.599004:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447168 00000100:00100000:3.0:1782228903.599009:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447168 00000100:00100000:3.0:1782228903.599037:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782228903.599044:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329447168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.605081:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329447168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6025us (6113us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.605095:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782228903.605174:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.605240:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.605297:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.605325:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c501cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228903.605343:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447296 00000100:00100000:3.0:1782228903.605348:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447296 00000100:00100000:3.0:1782228903.605383:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782228903.605392:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329447296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.605582:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329447296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.605589:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782228903.605662:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.606022:0:8442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8442:1868802329447424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228903.606054:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.606070:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447424 00000100:00100000:3.0:1782228903.606073:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447424 00000100:00100000:3.0:1782228903.606090:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782228903.606095:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8442:x1868802329447424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228903.606211:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8442:x1868802329447424:12345-0@lo:502:llog_process_th.0 Request processed in 115us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.606217:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782228903.606255:0:8442:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228903.608204:0:8442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8442:1868802329447424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782228903.608247:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782228903.608259:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228903.608619:0:8442:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782228903.608649:0:8442:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe7b8d6000 00000020:00000080:3.0:1782228903.608652:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782228903.612664:0:8442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8442:1868802329447552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228903.613668:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.613707:0:8442:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228903.614514:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447552 00000100:00100000:0.0:1782228903.614524:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447552 00000100:00100000:0.0:1782228903.614951:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1782228903.614961:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8442:x1868802329447552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228903.615256:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:8442:x1868802329447552:12345-0@lo:502:llog_process_th.0 Request processed in 295us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228903.615610:0:8442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8442:1868802329447552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782228903.615648:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782228903.615658:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782228903.615660:0:8442:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782228903.615671:0:8442:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782228903.623054:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782228903.623087:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782228903.623099:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.623112:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782228903.623378:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782228903.623381:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe50300000 from 4 10000000:01000000:2.0:1782228903.623384:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782228903.623452:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.623462:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.623473:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228903.623505:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.623581:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228903.623626:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9900 going to sleep for 11 seconds 00000100:00100000:2.0:1782228903.623654:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447680 00000100:00100000:2.0:1782228903.623661:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447680 00000100:00100000:2.0:1782228903.623708:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1782228903.623728:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329447680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228903.623744:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228903.623859:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e637cc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.623887:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.623896:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.623905:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b2200, rc 0) 00000100:00100000:2.0:1782228903.623941:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+20:5794:x1868802329447680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228903.623947:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1782228903.623995:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228903.624008:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.624018:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228903.624065:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.624089:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228903.624102:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9900 going to sleep for 11 seconds 00000100:00100000:2.0:1782228903.624114:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447808 00000100:00100000:2.0:1782228903.624117:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447808 00000100:00100000:0.0:1782228903.624253:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1782228903.624494:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1782228903.624507:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329447808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.625136:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329447808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 627us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228903.625143:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782228903.630788:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.630874:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228903.630963:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228903.630999:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228903.631086:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329447936 00000100:00100000:2.0:1782228903.631093:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329447936 00000100:00100000:2.0:1782228903.631154:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1782228903.631166:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329447936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.631712:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329447936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 546us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228903.631721:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1782228903.631787:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329447936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228903.632056:0:8444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8444:1868802329448064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228903.632097:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228903.632132:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448064 00000100:00100000:2.0:1782228903.632136:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448064 00000100:00100000:2.0:1782228903.632161:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782228903.632167:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:8444:x1868802329448064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228903.632480:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:8444:x1868802329448064:12345-0@lo:502:llog_process_th.0 Request processed in 311us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228903.632487:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782228903.632516:0:8444:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1782228903.632529:0:8444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8444:1868802329448064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228903.632560:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228903.632575:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228903.632578:0:8444:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782228903.632584:0:8444:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe50300000 00000020:00000080:2.0:1782228903.632586:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782228903.633239:0:8444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8444:1868802329448192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228903.634022:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228903.634050:0:8444:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e240 going to sleep for 11 seconds 00000100:00100000:0.0:1782228903.634339:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448192 00000100:00100000:0.0:1782228903.634347:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448192 00000100:00100000:0.0:1782228903.634461:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782228903.634471:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:8444:x1868802329448192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228903.634676:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:8444:x1868802329448192:12345-0@lo:502:llog_process_th.0 Request processed in 206us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228903.634684:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782228903.634857:0:8444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:8444:1868802329448192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228903.634917:0:8444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228903.634925:0:8444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228903.634927:0:8444:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1782228903.634931:0:8444:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782228903.634999:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782228903.635018:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782228903.635031:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228903.635043:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228904.316094:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228904.516991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228904.517041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228904.517086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228904.517087:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495808 00000100:00100000:3.0:1782228904.517097:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495808 00000100:00100000:2.0:1782228904.517160:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496064 00000100:00100000:2.0:1782228904.517176:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496064 00000100:00100000:3.0:1782228904.517181:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:1.0:1782228904.517185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228904.517193:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309495808:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228904.517223:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495936 00000100:00100000:2.0:1782228904.517227:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495936 00000100:00100000:1.0:1782228904.517230:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:1.0:1782228904.517242:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309496064:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228904.517253:0:6598:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782228904.517262:0:6598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782228904.517282:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309495808:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228904.517282:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309496064:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228904.517291:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:1.0:1782228904.517291:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:1.0:1782228904.517308:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:1.0:1782228904.517314:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309495936:12345-192.168.204.22@tcp:400:kworker.0 00000100:00080000:3.0:1782228904.517323:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228904.517327:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782228904.517329:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228904.517336:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309495936:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 23us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228904.517341:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:0.0:1782228904.517551:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309495680 00000100:00100000:0.0:1782228904.517556:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309495680 00000100:00100000:0.0:1782228904.517627:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 192 00000100:00100000:0.0:1782228904.517635:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309495680:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228904.517678:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309495680:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 44us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228904.517684:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 192 00010000:00010000:0.0:1782228905.340342:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228906.364479:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228907.391688:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228907.645322:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329448320:0@lo:400:kworker.0 00000100:00100000:3.0:1782228907.645350:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329448704:0@lo:400:kworker.0 00000100:00100000:3.0:1782228907.645502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228907.645502:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228907.645549:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448320 00000100:00100000:0.0:1782228907.645557:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448320 00000100:00100000:0.0:1782228907.645601:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782228907.645611:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329448320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228907.645666:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329448832:0@lo:400:kworker.0 00000100:00100000:0.0:1782228907.645680:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329448320:12345-0@lo:400:kworker.0 Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228907.645687:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1782228907.645698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228907.645719:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448832 00000100:00100000:0.0:1782228907.645722:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448832 00000100:00100000:2.0:1782228907.645728:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329448320:0@lo:400:kworker.0 00000100:00100000:0.0:1782228907.645752:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782228907.645758:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329448832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228907.645804:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329448832:12345-0@lo:400:kworker.0 Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228907.645810:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782228907.645838:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329448832:0@lo:400:kworker.0 00000100:00100000:3.0:1782228907.655118:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329448448:0@lo:400:kworker.0 00000100:00100000:3.0:1782228907.655199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228907.655260:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329448960:0@lo:400:kworker.0 00000100:00100000:1.0:1782228907.655332:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448448 00000100:00100000:1.0:1782228907.655343:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448448 00000100:00100000:1.0:1782228907.655392:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782228907.655402:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329448448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228907.655472:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329448448:12345-0@lo:400:kworker.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228907.655480:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782228907.655572:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228907.656309:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329448448:0@lo:400:kworker.0 00000100:00100000:3.0:1782228907.656327:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782228907.656336:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329448576:0@lo:400:kworker.0 00000100:00100000:1.0:1782228907.656362:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448704 00000100:00100000:3.0:1782228907.656386:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228907.656421:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329449088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228907.656455:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448576 00000100:00100000:0.0:1782228907.656459:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448576 00000100:00100000:3.0:1782228907.656465:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228907.656492:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782228907.656497:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329448960 00000100:00100000:0.0:1782228907.656498:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329448576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228907.656500:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448960 00000100:00100000:3.0:1782228907.656529:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782228907.656535:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329448960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228907.656545:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329448576:12345-0@lo:400:kworker.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228907.656551:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782228907.656561:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329448960:12345-0@lo:400:kworker.0 Request processed in 27us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228907.656567:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1782228907.656581:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782228907.656586:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228907.656598:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449088 00000100:00100000:3.0:1782228907.656601:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449088 00000100:00100000:3.0:1782228907.656630:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782228907.656637:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329449088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782228907.656676:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228907.656706:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329449088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228907.656712:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782228907.656736:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329448576:0@lo:400:kworker.0 00010000:00080000:3.0:1782228907.656747:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c4380 x1868802329449088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228907.656761:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329449088:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1782228907.656769:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7bd45180 x1868802329448960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228907.656777:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329448960:0@lo:400:kworker.0 00000100:00100000:1.0:1782228907.658587:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329448704 00000100:00100000:2.0:1782228907.658662:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1782228907.658691:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782228907.658730:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329448704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228907.658807:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329448704:12345-0@lo:400:kworker.0 Request processed in 82us (13306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228907.663955:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1782228907.664040:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7bd46d80 x1868802329448704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228907.664055:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329448704:0@lo:400:kworker.0 00000001:02000400:0.0:1782228908.113174:0:8671:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1782228908.156300:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782228908.156325:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329449216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228908.156393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228908.156529:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449216 00000100:00100000:2.0:1782228908.156537:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449216 00000100:00100000:2.0:1782228908.156590:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782228908.156600:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329449216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228908.156646:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228908.156692:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329449216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228908.156698:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1782228908.167267:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7bd45180 x1868802329449216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228908.167292:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329449216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228908.412245:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228909.449348:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228909.634288:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228909.634374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228909.634475:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496192 00000100:00100000:0.0:1782228909.634485:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496192 00000100:00100000:0.0:1782228909.634531:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 194 00000100:00100000:0.0:1782228909.634541:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309496192:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228909.634616:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309496192:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228909.634623:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 194 00000100:00100000:3.0:1782228909.634696:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496320 00000100:00100000:3.0:1782228909.634701:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496320 00000100:00100000:3.0:1782228909.634747:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:3.0:1782228909.634754:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309496320:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228909.634783:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309496320:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228909.634788:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00080000:0.0:1782228909.634940:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228909.651841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228909.651943:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496448 00000100:00100000:1.0:1782228909.651953:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496448 00000100:00100000:1.0:1782228909.652043:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:1.0:1782228909.652055:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2369:x1868802309496448:12345-192.168.204.22@tcp:9:kworker.0 00000020:00000080:1.0:1782228909.652099:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e6370f 00000100:00080000:1.0:1782228909.652109:0:6599:0:(import.c:65:import_set_state_nolock()) ffff98fe77c4f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782228909.652149:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782228909.652516:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+2:2369:x1868802309496448:12345-192.168.204.22@tcp:9:kworker.0 Request processed in 462us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228909.652525:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00010000:00010000:3.0:1782228909.653326:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782228909.653500:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782228909.654712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228909.654783:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496576 00000100:00100000:1.0:1782228909.654791:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496576 00000100:00100000:1.0:1782228909.654858:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:1.0:1782228909.654867:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2369:x1868802309496576:12345-192.168.204.22@tcp:9:kworker.0 00000020:00000080:1.0:1782228909.654909:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63716 00000100:00080000:1.0:1782228909.654919:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe77c49000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782228909.654981:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782228909.655720:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+2:2369:x1868802309496576:12345-192.168.204.22@tcp:9:kworker.0 Request processed in 851us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228909.655729:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00080000:0.0:1782228909.656314:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782228909.657781:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228910.463247:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228911.483688:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228912.507767:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228912.764731:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329449344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228912.764799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228912.764868:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449344 00000100:00100000:0.0:1782228912.764876:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449344 00000100:00100000:0.0:1782228912.764922:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782228912.764930:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329449344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782228912.764963:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228912.765014:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329449344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228912.765021:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1782228912.765055:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782228912.765082:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c5c00 x1868802329449344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228912.765099:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329449344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228912.765564:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329449600:0@lo:400:kworker.0 00000100:00100000:1.0:1782228912.765597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228912.765619:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782228912.765624:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329449472:0@lo:400:kworker.0 00000100:00100000:1.0:1782228912.765652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228912.765670:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329449984:0@lo:400:kworker.0 00000100:00100000:1.0:1782228912.765709:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228912.765736:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449600 00000100:00100000:1.0:1782228912.765740:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449600 00000100:00100000:1.0:1782228912.765767:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449984 00000100:00100000:1.0:1782228912.765771:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449984 00000100:00100000:1.0:1782228912.765791:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782228912.765798:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329449600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228912.765835:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329449600:12345-0@lo:400:kworker.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228912.765842:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782228912.765857:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782228912.765863:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329449984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228912.765888:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329449984:12345-0@lo:400:kworker.0 Request processed in 26us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228912.765894:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782228912.765923:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329449984:0@lo:400:kworker.0 00000100:00100000:1.0:1782228912.765943:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329449600:0@lo:400:kworker.0 00000100:00100000:0.0:1782228912.768622:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449472 00000100:00100000:0.0:1782228912.768633:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449472 00000100:00100000:0.0:1782228912.768684:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782228912.768692:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329449472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228912.768790:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329449472:12345-0@lo:400:kworker.0 Request processed in 98us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228912.768797:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782228912.768834:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329449728:0@lo:400:kworker.0 00000100:00100000:0.0:1782228912.768864:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228912.768889:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782228912.768896:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329449856:0@lo:400:kworker.0 00000100:00100000:0.0:1782228912.768916:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228912.768940:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449856 00000100:00100000:0.0:1782228912.768943:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449856 00000100:00100000:0.0:1782228912.768971:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782228912.768977:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329449856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228912.769019:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329449856:12345-0@lo:400:kworker.0 Request processed in 42us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228912.769025:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1782228912.769044:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782228912.769048:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782228912.769070:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77a29180 x1868802329449856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228912.769097:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329449856:0@lo:400:kworker.0 00000100:00100000:0.0:1782228912.769118:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329449728 00000100:00100000:0.0:1782228912.769120:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329449728 00000100:00100000:0.0:1782228912.769145:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782228912.769150:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329449728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228912.769183:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329449728:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228912.769189:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1782228912.769204:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228912.769218:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329449728:0@lo:400:kworker.0 00000100:00100000:3.0:1782228912.771684:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329449472:0@lo:400:kworker.0 00000100:00100000:3.0:1782228913.275776:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782228913.275799:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329450112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228913.275870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228913.275940:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329450112 00000100:00100000:3.0:1782228913.275948:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329450112 00000100:00100000:3.0:1782228913.276002:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782228913.276011:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329450112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782228913.276063:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228913.276107:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329450112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228913.276114:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1782228913.276165:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7bd45f80 x1868802329450112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228913.276193:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329450112:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1782228913.407018:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:0.0:1782228913.407028:0:6623:0:(genops.c:906:class_export_put()) final put ffff98fe77c4b000/2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:1.0:1782228913.407118:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77c4b000/2d74cab1-6977-468d-a933-6ac020ef49f3 for lustre-OST0000 00000020:00000080:1.0:1782228913.407173:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe77c4f800 for lustre-OST0000 00010000:00010000:2.0:1782228913.534666:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782228914.160424:0:8917:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing yml_node 00000001:00100000:0.0:1782228914.360773:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:0.0:1782228914.360783:0:7508:0:(genops.c:906:class_export_put()) final put ffff98fe77c4a000/2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:0.0:1782228914.360810:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77c4a000/2d74cab1-6977-468d-a933-6ac020ef49f3 for lustre-OST0001 00000020:00000080:0.0:1782228914.360855:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe77c49000 for lustre-OST0001 00010000:00010000:0.0:1782228914.563665:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228914.759706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228914.759748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228914.759815:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496704 00000100:00100000:1.0:1782228914.759825:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496704 00000100:00100000:1.0:1782228914.759878:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 196 00000100:00100000:1.0:1782228914.759888:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2373:x1868802309496704:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228914.759955:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2373:x1868802309496704:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 69us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228914.759973:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 196 00000100:00100000:3.0:1782228914.760039:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496832 00000100:00100000:3.0:1782228914.760045:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496832 00000100:00100000:3.0:1782228914.760103:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:3.0:1782228914.760111:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309496832:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228914.760140:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309496832:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228914.760145:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00080000:1.0:1782228914.760398:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782228915.579633:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228916.604224:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228917.627794:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228917.883704:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782228917.883726:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329450240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228917.883793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228917.883914:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329450240 00000100:00100000:0.0:1782228917.883922:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329450240 00000100:00100000:0.0:1782228917.883982:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782228917.883991:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329450240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782228917.884026:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228917.884078:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329450240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228917.884085:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782228917.884228:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329450624:0@lo:400:kworker.0 00000100:00100000:3.0:1782228917.884256:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228917.884274:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782228917.884278:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329450496:0@lo:400:kworker.0 00000100:00100000:3.0:1782228917.884294:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228917.884314:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329450624 00000100:00100000:3.0:1782228917.884317:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329450624 00000100:00100000:3.0:1782228917.884339:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329450496 00000100:00100000:3.0:1782228917.884341:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329450496 00000100:00100000:3.0:1782228917.884352:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782228917.884363:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329450624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228917.884395:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329450624:12345-0@lo:400:kworker.0 Request processed in 32us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228917.884400:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782228917.884412:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782228917.884416:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329450496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228917.884458:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329450496:12345-0@lo:400:kworker.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228917.884464:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782228917.884499:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329450496:0@lo:400:kworker.0 00000100:00100000:3.0:1782228917.884507:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329450624:0@lo:400:kworker.0 00000100:00080000:1.0:1782228917.884594:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782228917.884600:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782228917.884609:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329450368:0@lo:400:kworker.0 00000100:00100000:1.0:1782228917.884637:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228917.884672:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329450880:0@lo:400:kworker.0 00000100:00100000:1.0:1782228917.884690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782228917.884716:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c5880 x1868802329450240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228917.884730:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329450240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228917.884740:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782228917.884745:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329450752:0@lo:400:kworker.0 00000100:00100000:1.0:1782228917.884773:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228917.884795:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329450752 00000100:00100000:1.0:1782228917.884798:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329450752 00000100:00100000:1.0:1782228917.884826:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782228917.884832:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329450752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228917.884859:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329450752:12345-0@lo:400:kworker.0 Request processed in 27us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228917.884865:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1782228917.884879:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782228917.884891:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7bd46680 x1868802329450752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228917.884911:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329450752:0@lo:400:kworker.0 00000100:00100000:0.0:1782228917.884964:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329450368 00000100:00100000:0.0:1782228917.884968:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329450368 00000100:00100000:0.0:1782228917.884996:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782228917.885002:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329450368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228917.885031:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329450368:12345-0@lo:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228917.885036:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1782228917.885960:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329450368:0@lo:400:kworker.0 00000100:00100000:3.0:1782228917.886040:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329450880 00000100:00100000:3.0:1782228917.886046:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329450880 00000100:00100000:3.0:1782228917.886185:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782228917.886193:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329450880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228917.886256:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329450880:12345-0@lo:400:kworker.0 Request processed in 64us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228917.886262:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1782228917.886534:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228917.886566:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329450880:0@lo:400:kworker.0 00000100:00100000:3.0:1782228918.395985:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329451008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228918.396056:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228918.396240:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451008 00000100:00100000:0.0:1782228918.396251:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451008 00000100:00100000:0.0:1782228918.396308:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782228918.396318:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329451008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782228918.396354:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228918.396401:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329451008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228918.396408:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1782228918.396714:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c7480 x1868802329451008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228918.396733:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329451008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228918.655900:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782228919.440410:0:9108:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00010000:00010000:1.0:1782228919.679414:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228919.876468:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228919.876513:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497088 00000100:00100000:1.0:1782228919.876525:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497088 00000100:00100000:0.0:1782228919.876551:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00080000:2.0:1782228919.876601:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228919.876631:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:0.0:1782228919.876634:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309496960 00000100:00100000:0.0:1782228919.876639:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309496960 00000100:00100000:1.0:1782228919.876646:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2371:x1868802309497088:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228919.876685:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 198 00000100:00100000:0.0:1782228919.876694:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2371:x1868802309496960:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228919.876751:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2371:x1868802309496960:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228919.876768:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 198 00000100:00100000:1.0:1782228919.877001:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2371:x1868802309497088:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 349us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228919.877010:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 46 00010000:00010000:0.0:1782228920.700461:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228921.726358:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782228922.030376:0:9207:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:3.0:1782228922.755143:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228923.005717:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782228923.005740:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329451136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228923.005818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228923.005889:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451136 00000100:00100000:0.0:1782228923.005896:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451136 00000100:00100000:0.0:1782228923.005949:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782228923.005957:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329451136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782228923.005992:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228923.006051:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329451136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228923.006059:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1782228923.006080:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782228923.006175:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c5880 x1868802329451136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228923.006193:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329451136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782228923.020373:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329451264:0@lo:400:kworker.0 00000100:00100000:2.0:1782228923.020913:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228923.020969:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329451776:0@lo:400:kworker.0 00000100:00100000:2.0:1782228923.021013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228923.021940:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782228923.021954:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329451392:0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.022331:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329451648:0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.022364:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228923.022404:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782228923.022411:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329451520:0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.022461:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451264 00000100:00100000:1.0:1782228923.022470:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451264 00000100:00100000:1.0:1782228923.022519:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782228923.022529:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329451264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.022581:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329451264:12345-0@lo:400:kworker.0 Request processed in 54us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228923.022587:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782228923.022620:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451648 00000100:00100000:1.0:1782228923.022624:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451648 00000100:00100000:1.0:1782228923.022658:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782228923.022665:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329451648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.022699:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329451648:12345-0@lo:400:kworker.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228923.022706:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1782228923.022723:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782228923.024622:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228923.024690:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329451264:0@lo:400:kworker.0 00000100:00100000:2.0:1782228923.024738:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451776 00000100:00100000:2.0:1782228923.024744:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451776 00000100:00100000:2.0:1782228923.024786:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451392 00000100:00100000:2.0:1782228923.024789:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451392 00000100:00100000:1.0:1782228923.025908:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782228923.025922:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329451776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.026022:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329451776:12345-0@lo:400:kworker.0 Request processed in 104us (5007us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228923.026029:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782228923.026383:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782228923.026394:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329451392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228923.026447:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329451392:12345-0@lo:400:kworker.0 Request processed in 57us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228923.026453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782228923.026523:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782228923.026572:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e78380 x1868802329451648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228923.026584:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329451648:0@lo:400:kworker.0 00000100:00080000:1.0:1782228923.026618:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228923.026630:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451520 00000100:00100000:1.0:1782228923.026636:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451520 00000100:00100000:1.0:1782228923.026669:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782228923.026675:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329451520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.026711:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329451520:12345-0@lo:400:kworker.0 Request processed in 37us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228923.026716:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782228923.026745:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329451392:0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.026756:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329451776:0@lo:400:kworker.0 00000100:00080000:1.0:1782228923.026772:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228923.026784:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329451520:0@lo:400:kworker.0 00000100:00100000:1.0:1782228923.515964:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329451904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782228923.516047:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228923.516324:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329451904 00000100:00100000:0.0:1782228923.516332:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329451904 00000100:00100000:0.0:1782228923.516386:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782228923.516396:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329451904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782228923.516462:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228923.516511:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329451904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228923.516536:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1782228923.516592:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779c5880 x1868802329451904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228923.516609:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329451904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228923.772310:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228924.796133:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228924.990817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228924.990899:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497344 00000100:00100000:1.0:1782228924.990909:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497344 00000100:00100000:1.0:1782228924.990991:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:1.0:1782228924.991001:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2371:x1868802309497344:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228924.991079:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2371:x1868802309497344:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228924.991086:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00080000:3.0:1782228924.991538:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228924.991726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228924.991786:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497216 00000100:00100000:1.0:1782228924.991791:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497216 00000100:00100000:1.0:1782228924.991837:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 200 00000100:00100000:1.0:1782228924.991847:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309497216:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228924.991902:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309497216:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228924.991909:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 200 00000001:02000400:2.0:1782228925.159295:0:9305:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:3.0:1782228925.819690:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228926.845873:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782228927.035814:0:9354:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jun 23 11:35:25 EDT 2026 00010000:00010000:0.0:1782228927.869599:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228928.124622:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329452032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782228928.124712:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228928.124835:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329452160:0@lo:400:kworker.0 00000100:00100000:1.0:1782228928.124879:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228928.124887:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329452288:0@lo:400:kworker.0 00000100:00100000:1.0:1782228928.124917:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329452672:0@lo:400:kworker.0 00000100:00100000:2.0:1782228928.124921:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228928.124946:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782228928.124953:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329452416:0@lo:400:kworker.0 00000100:00100000:1.0:1782228928.124966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228928.124990:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452288 00000100:00100000:2.0:1782228928.124997:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452288 00000100:00100000:0.0:1782228928.125041:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452032 00000100:00100000:2.0:1782228928.125046:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782228928.125048:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452032 00000100:00100000:2.0:1782228928.125057:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329452288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228928.125094:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782228928.125103:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329452032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782228928.125126:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329452288:12345-0@lo:400:kworker.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228928.125133:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00002000:00000024:0.0:1782228928.125135:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228928.125165:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329452544:0@lo:400:kworker.0 00000100:00100000:0.0:1782228928.125180:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329452032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228928.125187:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782228928.125196:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782228928.125210:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782228928.125244:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe68fc3100 x1868802329452032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228928.125262:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329452032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782228928.125286:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452544 00000100:00100000:2.0:1782228928.125290:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452544 00000100:00100000:2.0:1782228928.125331:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782228928.125339:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329452544:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782228928.125353:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782228928.125534:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452160 00000100:00100000:1.0:1782228928.125538:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452160 00000100:00100000:1.0:1782228928.125564:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782228928.125570:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329452160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228928.125607:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329452160:12345-0@lo:400:kworker.0 Request processed in 37us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228928.125613:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1782228928.125712:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329452544:12345-0@lo:400:kworker.0 Request processed in 362us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228928.125718:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782228928.127280:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452672 00000100:00100000:1.0:1782228928.127293:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452672 00000100:00100000:1.0:1782228928.127426:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1782228928.127443:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228928.127452:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329452672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228928.127527:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329452672:12345-0@lo:400:kworker.0 Request processed in 79us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228928.127535:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782228928.127635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228928.127678:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452416 00000100:00100000:2.0:1782228928.127683:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452416 00000100:00100000:1.0:1782228928.127692:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329452288:0@lo:400:kworker.0 00000100:00100000:2.0:1782228928.127738:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782228928.127746:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228928.127758:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329452672:0@lo:400:kworker.0 00000100:00100000:1.0:1782228928.127783:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329452160:0@lo:400:kworker.0 00000100:00100000:2.0:1782228928.127784:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329452416:12345-0@lo:400:kworker.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228928.127790:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1782228928.127817:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228928.127835:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329452416:0@lo:400:kworker.0 00010000:00080000:0.0:1782228928.132112:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e78700 x1868802329452544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228928.132130:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329452544:0@lo:400:kworker.0 00000100:00100000:0.0:1782228928.635646:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782228928.635680:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329452800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782228928.635790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228928.636837:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452800 00000100:00100000:1.0:1782228928.636852:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452800 00000100:00100000:1.0:1782228928.636919:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782228928.636928:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329452800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782228928.636966:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228928.637043:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329452800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228928.637050:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782228928.638522:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe68fc1c00 x1868802329452800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228928.638558:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329452800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782228928.891772:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228929.916700:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228930.115764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228930.115853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228930.115981:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497600 00000100:00100000:2.0:1782228930.115992:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497600 00000100:00100000:2.0:1782228930.116069:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 54 00000100:00100000:2.0:1782228930.116080:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309497600:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228930.116153:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309497600:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228930.116160:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 54 00000100:00080000:0.0:1782228930.116214:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228930.116338:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497472 00000100:00100000:1.0:1782228930.116343:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497472 00000100:00100000:1.0:1782228930.116402:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 202 00000100:00100000:1.0:1782228930.116410:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2373:x1868802309497472:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228930.116474:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2373:x1868802309497472:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 65us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228930.116482:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 202 00010000:00010000:0.0:1782228930.940937:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228931.967997:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228932.987701:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228933.243915:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329453056:0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.243995:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228933.244050:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329453568:0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.244070:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228933.244088:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782228933.244091:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329453184:0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.244103:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228933.244111:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329453696:0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.244134:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228933.244166:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329453312:0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.244180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228933.244190:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782228933.244193:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329452928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228933.244204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228933.244219:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329453440:0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.244237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228933.244270:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453696 00000100:00100000:1.0:1782228933.244276:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453696 00000100:00100000:1.0:1782228933.244323:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453440 00000100:00100000:1.0:1782228933.244326:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453440 00000100:00100000:1.0:1782228933.244347:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782228933.244355:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329453696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.244410:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329453696:12345-0@lo:400:kworker.0 Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228933.244418:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782228933.244462:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782228933.244468:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329453440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228933.244501:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329453440:12345-0@lo:400:kworker.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228933.244508:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782228933.244523:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329452928 00000100:00100000:1.0:1782228933.244526:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329452928 00000100:00100000:1.0:1782228933.244549:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782228933.244556:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329452928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228933.244593:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228933.244638:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329452928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228933.244644:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1782228933.244663:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782228933.244666:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782228933.244693:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e79880 x1868802329452928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228933.244711:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329452928:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782228933.244720:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe74e78e00 x1868802329453440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228933.244728:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329453440:0@lo:400:kworker.0 00010000:00080000:1.0:1782228933.244758:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77b90000 x1868802329453696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228933.244766:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329453696:0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245055:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453056 00000100:00100000:2.0:1782228933.245059:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453056 00000100:00100000:2.0:1782228933.245095:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782228933.245103:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329453056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245160:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329453056:12345-0@lo:400:kworker.0 Request processed in 58us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228933.245166:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782228933.245199:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453568 00000100:00100000:2.0:1782228933.245203:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453568 00000100:00100000:2.0:1782228933.245226:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453184 00000100:00100000:2.0:1782228933.245229:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453184 00000100:00100000:2.0:1782228933.245240:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453312 00000100:00100000:2.0:1782228933.245242:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453312 00000100:00100000:2.0:1782228933.245257:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782228933.245263:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329453568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245294:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329453568:12345-0@lo:400:kworker.0 Request processed in 31us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228933.245300:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782228933.245312:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782228933.245317:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329453184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245351:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329453184:12345-0@lo:400:kworker.0 Request processed in 33us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228933.245356:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782228933.245367:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782228933.245373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329453312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245403:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329453312:12345-0@lo:400:kworker.0 Request processed in 30us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228933.245408:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1782228933.245453:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228933.245473:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329453312:0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245499:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329453184:0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245507:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329453056:0@lo:400:kworker.0 00000100:00100000:2.0:1782228933.245516:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329453568:0@lo:400:kworker.0 00000100:00100000:0.0:1782228933.757854:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782228933.757947:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329453824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782228933.758017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228933.758082:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453824 00000100:00100000:0.0:1782228933.758090:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453824 00000100:00100000:0.0:1782228933.758140:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782228933.758149:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329453824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782228933.758532:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228933.758670:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329453824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 520us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228933.758678:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1782228933.758733:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe68fc0e00 x1868802329453824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228933.758753:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329453824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228934.012746:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228935.052498:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228935.233759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228935.233818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228935.233878:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497728 00000100:00100000:1.0:1782228935.233891:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497728 00000100:00100000:3.0:1782228935.233911:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497856 00000100:00100000:3.0:1782228935.233916:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497856 00000100:00100000:1.0:1782228935.233959:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 204 00000100:00100000:1.0:1782228935.233971:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309497728:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228935.233973:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:3.0:1782228935.233979:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309497856:12345-192.168.204.22@tcp:400:kworker.0 00000100:00080000:0.0:1782228935.234057:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228935.234065:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2370:x1868802309497728:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228935.234074:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 204 00000100:00100000:3.0:1782228935.247086:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309497856:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 13088us (13248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228935.247106:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 58 00010000:00010000:0.0:1782228936.060796:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228937.085050:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228938.108309:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228938.363605:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329453952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228938.363710:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228938.363821:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329453952 00000100:00100000:1.0:1782228938.363831:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329453952 00000100:00100000:1.0:1782228938.363915:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782228938.363926:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329453952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228938.363974:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228938.364027:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329453952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228938.364034:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1782228938.365204:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782228938.365256:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77b90000 x1868802329453952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228938.365282:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329453952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782228938.366707:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329454208:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.366790:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228938.366839:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782228938.366844:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329454080:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.366885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228938.366918:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329454592:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.366944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228938.366978:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454080 00000100:00100000:3.0:1782228938.366985:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454080 00000100:00100000:3.0:1782228938.367035:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782228938.367057:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329454080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367112:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329454080:12345-0@lo:400:kworker.0 Request processed in 56us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228938.367137:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782228938.367179:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329454336:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228938.367224:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228938.367230:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329454464:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367255:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228938.367283:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454208 00000100:00100000:3.0:1782228938.367287:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454208 00000100:00100000:3.0:1782228938.367310:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454592 00000100:00100000:3.0:1782228938.367312:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454592 00000100:00100000:3.0:1782228938.367336:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454336 00000100:00100000:3.0:1782228938.367338:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454336 00000100:00100000:3.0:1782228938.367358:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782228938.367364:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329454208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367398:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329454208:12345-0@lo:400:kworker.0 Request processed in 34us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228938.367405:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782228938.367418:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782228938.367424:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329454592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367477:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329454592:12345-0@lo:400:kworker.0 Request processed in 54us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228938.367484:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782228938.367494:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782228938.367511:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329454336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367542:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329454336:12345-0@lo:400:kworker.0 Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228938.367557:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782228938.367577:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454464 00000100:00100000:3.0:1782228938.367581:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454464 00000100:00100000:3.0:1782228938.367610:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782228938.367617:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329454464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367649:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329454464:12345-0@lo:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228938.367654:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1782228938.367673:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228938.367678:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782228938.367705:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7bd46300 x1868802329454464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228938.367718:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329454464:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367730:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329454336:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367760:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329454080:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367768:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329454592:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.367778:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329454208:0@lo:400:kworker.0 00000100:00100000:3.0:1782228938.877094:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329454720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228938.877200:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228938.877367:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454720 00000100:00100000:2.0:1782228938.877377:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454720 00000100:00100000:2.0:1782228938.877461:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782228938.877473:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329454720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228938.877532:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228938.877592:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329454720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228938.877599:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1782228938.877731:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e79880 x1868802329454720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228938.877754:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329454720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228939.133568:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228940.155717:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228940.350272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228940.350351:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228940.350500:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309497984 00000100:00100000:1.0:1782228940.350513:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309497984 00000100:00100000:1.0:1782228940.350591:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 206 00000100:00100000:1.0:1782228940.350602:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309497984:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228940.350769:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309497984:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 168us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228940.350778:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 206 00000100:00100000:3.0:1782228940.350903:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309498112 00000100:00100000:3.0:1782228940.350915:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309498112 00000100:00100000:3.0:1782228940.350966:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:3.0:1782228940.350975:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309498112:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228940.351015:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309498112:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 41us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228940.351021:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00080000:1.0:1782228940.351142:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782228941.179707:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228942.203821:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228943.228757:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228943.485605:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329454848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228943.485685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228943.485790:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454848 00000100:00100000:1.0:1782228943.485799:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454848 00000100:00100000:1.0:1782228943.485858:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782228943.485866:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329454848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228943.485902:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228943.485942:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329454848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228943.485965:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1782228943.486018:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782228943.486046:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77b90000 x1868802329454848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228943.486064:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329454848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228943.489618:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329455104:0@lo:400:kworker.0 00000100:00100000:1.0:1782228943.489688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228943.489719:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782228943.489724:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329455232:0@lo:400:kworker.0 00000100:00100000:1.0:1782228943.489742:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228943.489771:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329455104 00000100:00100000:1.0:1782228943.489777:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329455104 00000100:00100000:1.0:1782228943.489814:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329455232 00000100:00100000:1.0:1782228943.489816:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329455232 00000100:00100000:1.0:1782228943.489837:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782228943.489845:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329455104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228943.489888:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329455104:12345-0@lo:400:kworker.0 Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228943.489895:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782228943.489908:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782228943.489913:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329455232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228943.489935:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329455232:12345-0@lo:400:kworker.0 Request processed in 23us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228943.489940:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782228943.489976:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329455232:0@lo:400:kworker.0 00000100:00100000:1.0:1782228943.489985:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329455104:0@lo:400:kworker.0 00000100:00080000:0.0:1782228943.490048:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228943.490071:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329455360:0@lo:400:kworker.0 00000100:00100000:0.0:1782228943.490099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228943.490123:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782228943.490139:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329454976:0@lo:400:kworker.0 00000100:00100000:0.0:1782228943.490164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228943.490186:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329455488:0@lo:400:kworker.0 00000100:00100000:0.0:1782228943.490204:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228943.490224:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329454976 00000100:00100000:0.0:1782228943.490227:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329454976 00000100:00100000:0.0:1782228943.490249:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1782228943.490255:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329454976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228943.490281:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329454976:12345-0@lo:400:kworker.0 Request processed in 26us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228943.490286:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1782228943.490309:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329455488 00000100:00100000:0.0:1782228943.490312:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329455488 00000100:00100000:0.0:1782228943.490347:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782228943.490352:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329455488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228943.490376:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329455488:12345-0@lo:400:kworker.0 Request processed in 24us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228943.490381:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1782228943.490393:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228943.490785:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329454976:0@lo:400:kworker.0 00000100:00100000:0.0:1782228943.490796:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329455488:0@lo:400:kworker.0 00000100:00100000:1.0:1782228943.491062:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329455360 00000100:00100000:1.0:1782228943.491066:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329455360 00000100:00100000:1.0:1782228943.491116:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782228943.494002:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329455360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228943.494104:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329455360:12345-0@lo:400:kworker.0 Request processed in 2976us (4002us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228943.494113:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782228943.494229:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782228943.494269:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77b91180 x1868802329455360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228943.494282:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329455360:0@lo:400:kworker.0 00000001:02000400:0.0:1782228943.519937:0:9983:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:35:42 (1782228942) === 00000100:00100000:1.0:1782228943.928784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228943.929993:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309498240 00000100:00100000:2.0:1782228943.930006:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309498240 00000100:00100000:2.0:1782228943.930112:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 208 00000100:00100000:2.0:1782228943.930122:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:8139:x1868802309498240:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782228943.930139:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228943.930158:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e637da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994965b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228943.930187:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e637da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994965b expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228943.930199:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e637da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994965b expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228943.930208:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b3400, rc 0) 00000100:00100000:2.0:1782228943.930273:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8139:x1868802309498240:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 152us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228943.930280:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 208 00000100:00100000:3.0:1782228943.932689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228943.934503:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309498368 00000100:00100000:0.0:1782228943.934517:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309498368 00000100:00100000:0.0:1782228943.934580:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 209 00000100:00100000:0.0:1782228943.934590:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8139:x1868802309498368:12345-192.168.204.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782228943.934975:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8139:x1868802309498368:12345-192.168.204.22@tcp:501:mount.lustre.0 Request processed in 384us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228943.934984:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 209 00000100:00100000:3.0:1782228943.937687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228943.937844:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309498496 00000100:00100000:2.0:1782228943.937854:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309498496 00000100:00100000:2.0:1782228943.937904:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 210 00000100:00100000:2.0:1782228943.937913:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8139:x1868802309498496:12345-192.168.204.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782228943.938130:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8139:x1868802309498496:12345-192.168.204.22@tcp:503:mount.lustre.0 Request processed in 217us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228943.938138:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 210 00000100:00100000:3.0:1782228943.947320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228943.947763:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309498624 00000100:00100000:2.0:1782228943.947776:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309498624 00000100:00100000:2.0:1782228943.947845:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 211 00000100:00100000:2.0:1782228943.947858:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8144:x1868802309498624:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782228943.948314:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8144:x1868802309498624:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 458us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228943.948324:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 211 00000100:00100000:3.0:1782228943.970479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228943.970726:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309498752 00000100:00100000:1.0:1782228943.970739:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309498752 00000100:00100000:1.0:1782228943.970810:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 212 00000100:00100000:1.0:1782228943.970822:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8144:x1868802309498752:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782228943.971188:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8144:x1868802309498752:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 367us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228943.971198:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 212 00000100:00100000:3.0:1782228943.979950:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228943.980230:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309498880 00000100:00100000:2.0:1782228943.980244:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309498880 00000100:00100000:2.0:1782228943.980325:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 213 00000100:00100000:2.0:1782228943.980337:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:8139:x1868802309498880:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782228943.980360:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228943.980384:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e637e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949685 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228943.980471:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e637e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949685 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228943.980485:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e637e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949685 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228943.980497:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe605b2000, rc 0) 00000100:00100000:2.0:1782228943.980569:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:8139:x1868802309498880:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 235us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228943.980577:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 213 00000100:00100000:3.0:1782228943.984571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228943.984691:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499008 00000100:00100000:0.0:1782228943.984713:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499008 00000100:00100000:0.0:1782228943.984786:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 214 00000100:00100000:0.0:1782228943.984796:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:8139:x1868802309499008:12345-192.168.204.22@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782228943.984831:0:5792:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782228943.984869:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782228943.984873:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782228943.984876:0:5792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782228943.984879:0:5792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782228943.988163:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:8139:x1868802309499008:12345-192.168.204.22@tcp:256:mount.lustre.0 Request processed in 3349us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228943.988182:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 214 00000100:00100000:2.0:1782228943.995116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228943.995219:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499136 00000100:00100000:1.0:1782228943.995231:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499136 00000100:00100000:1.0:1782228943.995298:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 215 00000100:00100000:1.0:1782228943.995308:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:8139:x1868802309499136:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782228943.995331:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228943.995355:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994968c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228943.995402:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228943.995415:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228943.995426:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82050600, rc 0) 00000100:00100000:1.0:1782228943.995566:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8139:x1868802309499136:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 259us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228943.995573:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 215 00000100:00100000:2.0:1782228943.998015:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782228943.998061:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329455616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782228943.998141:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228943.998225:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329455616 00000100:00100000:2.0:1782228943.998234:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329455616 00000100:00100000:2.0:1782228943.998289:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782228943.998298:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329455616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228943.998345:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228943.998407:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329455616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228943.998415:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782228943.998489:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73e7bb80 x1868802329455616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228943.998512:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329455616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782228944.007071:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228944.007323:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499264 00000100:00100000:0.0:1782228944.007336:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499264 00000100:00100000:0.0:1782228944.007449:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 216 00000100:00100000:0.0:1782228944.007462:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8139:x1868802309499264:12345-192.168.204.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782228944.009518:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8139:x1868802309499264:12345-192.168.204.22@tcp:501:mount.lustre.0 Request processed in 2042us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228944.009544:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 216 00000100:00100000:0.0:1782228944.013100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228944.013313:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499392 00000100:00100000:2.0:1782228944.013331:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499392 00000100:00100000:2.0:1782228944.013411:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 217 00000100:00100000:2.0:1782228944.013423:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8139:x1868802309499392:12345-192.168.204.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782228944.015287:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8139:x1868802309499392:12345-192.168.204.22@tcp:503:mount.lustre.0 Request processed in 1858us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228944.015302:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 217 00000100:00100000:2.0:1782228944.025409:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228944.025559:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499520 00000100:00100000:3.0:1782228944.025572:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499520 00000100:00100000:3.0:1782228944.025647:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 218 00000100:00100000:3.0:1782228944.025658:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8145:x1868802309499520:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782228944.026230:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8145:x1868802309499520:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 570us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228944.026240:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 218 00000100:00100000:0.0:1782228944.034913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228944.035660:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499648 00000100:00100000:3.0:1782228944.035676:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499648 00000100:00100000:3.0:1782228944.035759:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 219 00000100:00100000:3.0:1782228944.035771:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8145:x1868802309499648:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782228944.036401:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:8145:x1868802309499648:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 619us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228944.036421:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 219 00000100:00100000:0.0:1782228944.049000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228944.049116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228944.051067:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500160 00000100:00100000:1.0:1782228944.051086:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500160 00000100:00100000:1.0:1782228944.051182:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499776 00000100:00100000:1.0:1782228944.051186:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499776 00000100:00100000:1.0:1782228944.051206:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:1.0:1782228944.051218:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309500160:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228944.051324:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309500160:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 108us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228944.051332:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:1.0:1782228944.051353:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:1.0:1782228944.051358:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2369:x1868802309499776:12345-192.168.204.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782228944.051384:0:5798:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 4188f868-851e-4c26-a016-17a3b5288455@192.168.204.22@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1782228944.051461:0:5798:0:(genops.c:1406:class_connect()) connect: client 4188f868-851e-4c26-a016-17a3b5288455, cookie 0x8e1c8a3488e637ef 00000004:00100000:1.0:1782228944.051502:0:5798:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782228944.051787:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782228944.052162:0:5798:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe2c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782228944.052211:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+6:2369:x1868802309499776:12345-192.168.204.22@tcp:38:mount.lustre.0 Request processed in 851us (3095us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228944.052220:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:2.0:1782228944.060633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228944.060743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228944.061067:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309499904 00000100:00100000:0.0:1782228944.061080:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309499904 00000100:00100000:0.0:1782228944.061165:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500032 00000100:00100000:0.0:1782228944.061169:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500032 00000100:00100000:0.0:1782228944.061189:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:0.0:1782228944.061199:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+7:0:x1868802309499904:12345-192.168.204.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782228944.061272:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782228944.061787:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+7:0:x1868802309499904:12345-192.168.204.22@tcp:41:mount.lustre.0 Request processed in 576us (1155us total) trans 0 rc 0/0 00000100:00080000:2.0:1782228944.061805:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228944.061825:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:0.0:1782228944.061873:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:0.0:1782228944.061885:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:8139:x1868802309500032:12345-192.168.204.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782228944.061917:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782228944.061946:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:8139:x1868802309500032:12345-192.168.204.22@tcp:41:mount.lustre.0 Request processed in 65us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228944.061953:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:0.0:1782228944.075174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228944.075622:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500288 00000100:00100000:3.0:1782228944.075638:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500288 00000100:00100000:3.0:1782228944.075780:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:3.0:1782228944.075792:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+6:8139:x1868802309500288:12345-192.168.204.22@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782228944.075900:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+6:8139:x1868802309500288:12345-192.168.204.22@tcp:40:mount.lustre.0 Request processed in 110us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228944.075908:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:0.0:1782228944.086949:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228944.086986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228944.087025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228944.087154:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500672 00000100:00100000:2.0:1782228944.087164:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500672 00000100:00100000:2.0:1782228944.087270:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:2.0:1782228944.087281:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4188f868-851e-4c26-a016-17a3b5288455+6:8139:x1868802309500672:12345-192.168.204.22@tcp:33:mount.lustre.0 00000100:00100000:1.0:1782228944.087281:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500416 00000100:00100000:1.0:1782228944.087285:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500416 00000100:00100000:1.0:1782228944.087305:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500544 00000100:00100000:1.0:1782228944.087307:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500544 00000100:00100000:1.0:1782228944.087321:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:1.0:1782228944.087600:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2369:x1868802309500416:12345-192.168.204.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782228944.087622:0:6598:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 4188f868-851e-4c26-a016-17a3b5288455@192.168.204.22@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1782228944.087653:0:6598:0:(genops.c:1406:class_connect()) connect: client 4188f868-851e-4c26-a016-17a3b5288455, cookie 0x8e1c8a3488e637f6 00002000:00100000:1.0:1782228944.087663:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4188f868-851e-4c26-a016-17a3b5288455/ffff98fe7fe2d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782228944.087674:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:2.0:1782228944.087790:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:1.0:1782228944.087863:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782228944.087889:0:6598:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe2f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782228944.087921:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4188f868-851e-4c26-a016-17a3b5288455+6:8139:x1868802309500672:12345-192.168.204.22@tcp:33:mount.lustre.0 Request processed in 643us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228944.087922:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188f868-851e-4c26-a016-17a3b5288455+6:2369:x1868802309500416:12345-192.168.204.22@tcp:8:mount.lustre.0 Request processed in 324us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228944.087930:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:3.0:1782228944.091811:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:3.0:1782228944.091834:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2369:x1868802309500544:12345-192.168.204.22@tcp:8:mount.lustre.0 00000100:00100000:1.0:1782228944.092249:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00010000:00080000:2.0:1782228944.092617:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 4188f868-851e-4c26-a016-17a3b5288455@192.168.204.22@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1782228944.092805:0:6599:0:(genops.c:1406:class_connect()) connect: client 4188f868-851e-4c26-a016-17a3b5288455, cookie 0x8e1c8a3488e637fd 00002000:00100000:2.0:1782228944.092824:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4188f868-851e-4c26-a016-17a3b5288455/ffff98fe77a80800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782228944.092840:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782228944.093148:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782228944.093194:0:6599:0:(import.c:65:import_set_state_nolock()) ffff98fe77a86800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782228944.093302:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4188f868-851e-4c26-a016-17a3b5288455+6:2369:x1868802309500544:12345-192.168.204.22@tcp:8:mount.lustre.0 Request processed in 1473us (6313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228944.093313:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00010000:00010000:3.0:1782228944.253943:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782228944.560907:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4188f868-851e-4c26-a016-17a3b5288455 00000001:00100000:0.0:1782228945.078997:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4188f868-851e-4c26-a016-17a3b5288455 00010000:00010000:0.0:1782228945.279645:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228946.300566:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228947.330221:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228948.347675:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228948.604268:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329455872:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.604351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228948.604417:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329456384:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.604463:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228948.604494:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228948.604500:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329456000:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.604523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228948.604570:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456384 00000100:00100000:3.0:1782228948.604578:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456384 00000100:00100000:3.0:1782228948.604630:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782228948.604639:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329456384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.604694:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329456384:12345-0@lo:400:kworker.0 Request processed in 56us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228948.604718:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782228948.604744:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329455872 00000100:00100000:3.0:1782228948.604748:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329455872 00000100:00100000:3.0:1782228948.604776:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456000 00000100:00100000:3.0:1782228948.604779:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456000 00000100:00100000:0.0:1782228948.604790:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329456128:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.604797:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782228948.604806:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329455872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228948.604834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228948.604859:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782228948.604865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329455872:12345-0@lo:400:kworker.0 Request processed in 59us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228948.604867:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329455744:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.604880:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782228948.604893:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782228948.604900:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329456000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228948.604919:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228948.604941:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329456000:12345-0@lo:400:kworker.0 Request processed in 41us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228948.604948:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782228948.604952:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329456256:0@lo:400:kworker.0 00000100:00100000:0.0:1782228948.604981:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228948.604996:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329456000:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.605012:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329455872:0@lo:400:kworker.0 00010000:00080000:3.0:1782228948.605025:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77b91180 x1868802329456384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228948.605037:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329456384:0@lo:400:kworker.0 00000100:00100000:0.0:1782228948.605045:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456128 00000100:00100000:0.0:1782228948.605049:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456128 00000100:00100000:3.0:1782228948.605060:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228948.605068:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329456512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228948.605081:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782228948.605097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228948.605102:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329456128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.605144:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329455744 00000100:00100000:3.0:1782228948.605154:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329455744 00000100:00100000:0.0:1782228948.605160:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329456128:12345-0@lo:400:kworker.0 Request processed in 62us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228948.605168:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782228948.605184:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782228948.605193:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329455744:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1782228948.605206:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77b91500 x1868802329456128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228948.605218:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329456128:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.605231:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329455744:12345-0@lo:400:kworker.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228948.605238:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1782228948.605241:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329455744:0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.605269:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456256 00000100:00100000:3.0:1782228948.605273:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456256 00000100:00100000:3.0:1782228948.605293:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782228948.605311:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329456256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228948.605343:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329456256:12345-0@lo:400:kworker.0 Request processed in 44us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228948.605349:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782228948.605504:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329456256:0@lo:400:kworker.0 00000100:00080000:2.0:1782228948.606259:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782228948.606265:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782228948.606268:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782228948.606285:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456512 00000100:00100000:2.0:1782228948.606290:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456512 00000100:00100000:2.0:1782228948.606343:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782228948.606351:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329456512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782228948.606722:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228948.606789:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329456512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 438us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228948.606810:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1782228948.610022:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe68fc0700 x1868802329456512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228948.610051:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329456512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782228949.115561:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782228949.115584:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329456640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782228949.115652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228949.115731:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456640 00000100:00100000:2.0:1782228949.115740:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456640 00000100:00100000:2.0:1782228949.115785:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782228949.115794:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329456640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228949.115829:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228949.115872:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329456640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228949.115880:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1782228949.115922:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe50c8df80 x1868802329456640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228949.115939:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329456640:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1782228949.152608:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4188f868-851e-4c26-a016-17a3b5288455 00010000:00010000:2.0:1782228949.372765:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782228949.563579:0:10180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1782228949.568244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228949.568303:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228949.568337:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228949.568361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228949.568412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228949.568472:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501312 00000100:00100000:0.0:1782228949.568481:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501312 00000100:00100000:0.0:1782228949.568536:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501184 00000100:00100000:0.0:1782228949.568540:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501184 00000100:00100000:0.0:1782228949.568567:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:0.0:1782228949.568577:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501312:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228949.568652:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501312:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 76us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228949.568660:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:0.0:1782228949.568679:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:0.0:1782228949.568687:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501184:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228949.568723:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501184:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228949.568730:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:0.0:1782228949.568751:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501056 00000100:00100000:0.0:1782228949.568755:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501056 00000100:00100000:0.0:1782228949.568778:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500928 00000100:00100000:0.0:1782228949.568781:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500928 00000100:00100000:0.0:1782228949.568799:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:0.0:1782228949.568806:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501056:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228949.568837:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501056:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228949.568844:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:0.0:1782228949.568856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 71 00000100:00100000:0.0:1782228949.568863:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309500928:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228949.568887:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309500928:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228949.568893:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 71 00000100:00080000:0.0:1782228949.568914:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782228949.568918:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782228949.568920:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782228949.569122:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309500800 00000100:00100000:1.0:1782228949.569128:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309500800 00000100:00100000:1.0:1782228949.569171:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 221 00000100:00100000:1.0:1782228949.569180:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309500800:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228949.569208:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309500800:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 31us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228949.569216:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 221 00010000:00010000:3.0:1782228950.397911:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228951.420564:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228952.444056:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228953.467829:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228953.729603:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329456768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782228953.729718:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228953.729819:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456768 00000100:00100000:3.0:1782228953.729831:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456768 00000100:00100000:3.0:1782228953.729912:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782228953.729924:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329456768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782228953.729974:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228953.730042:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329456768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228953.730051:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1782228953.730076:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782228953.730133:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7bd46a00 x1868802329456768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228953.730155:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329456768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782228953.732504:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329456896:0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.732532:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329457152:0@lo:400:kworker.0 00000100:00100000:3.0:1782228953.732611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228953.732669:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329457408:0@lo:400:kworker.0 00000100:00100000:3.0:1782228953.732700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228953.732736:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228953.732746:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329457024:0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.732749:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228953.732784:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782228953.732785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228953.732794:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329457280:0@lo:400:kworker.0 00000100:00100000:3.0:1782228953.732827:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329456896 00000100:00100000:3.0:1782228953.732837:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329456896 00000100:00100000:0.0:1782228953.732845:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228953.732898:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1782228953.732902:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457408 00000100:00100000:0.0:1782228953.732907:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457408 00000100:00100000:3.0:1782228953.732912:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329456896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228953.732973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329456896:12345-0@lo:400:kworker.0 Request processed in 65us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228953.732980:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1782228953.733020:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457152 00000100:00100000:0.0:1782228953.733022:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457024 00000100:00100000:3.0:1782228953.733024:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457152 00000100:00100000:0.0:1782228953.733028:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457024 00000100:00100000:3.0:1782228953.733053:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782228953.733113:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782228953.733124:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329457152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228953.733170:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329457408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.733182:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329457152:12345-0@lo:400:kworker.0 Request processed in 60us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228953.733219:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329457408:12345-0@lo:400:kworker.0 Request processed in 158us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228953.733233:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782228953.733248:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1782228953.733257:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1782228953.733380:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782228953.733396:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782228953.733479:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329457024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.733513:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329457024:12345-0@lo:400:kworker.0 Request processed in 111us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228953.733520:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782228953.733619:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457280 00000100:00100000:2.0:1782228953.733621:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329456896:0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.733625:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457280 00000100:00100000:2.0:1782228953.733659:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329457024:0@lo:400:kworker.0 00000100:00100000:2.0:1782228953.733671:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329457408:0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.733679:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782228953.733689:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329457280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.733728:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329457280:12345-0@lo:400:kworker.0 Request processed in 41us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228953.733735:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1782228953.733768:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c89f80 x1868802329457280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228953.733780:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329457280:0@lo:400:kworker.0 00000100:00100000:0.0:1782228953.733792:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329457152:0@lo:400:kworker.0 00000100:00080000:0.0:1782228953.734044:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782228953.734050:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228954.236804:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228954.236828:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329457536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228954.236911:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228954.237228:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457536 00000100:00100000:2.0:1782228954.237236:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457536 00000100:00100000:2.0:1782228954.237300:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782228954.237310:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329457536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228954.237347:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228954.237424:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329457536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (511us total) trans 0 rc 0/0 00010000:00080000:3.0:1782228954.237482:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe50c8df80 x1868802329457536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228954.237501:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329457536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782228954.237637:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1782228954.492014:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228954.686208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228954.686308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228954.686349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228954.686391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228954.686494:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501440 00000100:00100000:1.0:1782228954.686504:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501440 00000100:00100000:1.0:1782228954.686569:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 223 00000100:00100000:1.0:1782228954.686581:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309501440:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228954.686654:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309501440:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228954.686680:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 223 00000100:00100000:2.0:1782228954.686881:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501824 00000100:00100000:2.0:1782228954.686886:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501824 00000100:00100000:2.0:1782228954.686936:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:2.0:1782228954.686944:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501824:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228954.686977:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501824:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 35us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228954.686983:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00080000:1.0:1782228954.687133:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782228954.690314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228954.691714:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501952 00000100:00100000:1.0:1782228954.691726:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501952 00000100:00100000:1.0:1782228954.691798:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:1.0:1782228954.691807:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501952:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228954.691888:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501952:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 83us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228954.691896:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00080000:3.0:1782228954.692695:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782228954.693593:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501568 00000100:00100000:0.0:1782228954.693603:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501568 00000100:00100000:0.0:1782228954.693716:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309501696 00000100:00100000:0.0:1782228954.693720:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309501696 00000100:00100000:1.0:1782228954.693760:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 75 00000100:00100000:1.0:1782228954.693770:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309501568:12345-192.168.204.22@tcp:400:kworker.0 00000100:00080000:3.0:1782228954.693825:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782228954.693841:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309501568:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 71us (7640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228954.693848:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 75 00000100:00100000:1.0:1782228954.693866:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 76 00000100:00100000:1.0:1782228954.693872:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501696:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228954.693891:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309501696:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 20us (7500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228954.693897:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 76 00010000:00010000:0.0:1782228955.516543:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228956.539699:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228957.563942:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228958.589649:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228958.843600:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329457664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228958.843683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228958.844922:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782228958.844934:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329457792:0@lo:400:kworker.0 00000100:00100000:0.0:1782228958.844972:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228958.845029:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457664 00000100:00100000:0.0:1782228958.845036:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457664 00000100:00100000:0.0:1782228958.845082:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782228958.845089:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329457664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782228958.845137:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228958.845177:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329457664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228958.845184:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1782228958.845222:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c60a80 x1868802329457664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228958.845402:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329457664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228958.845466:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457792 00000100:00100000:0.0:1782228958.845469:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457792 00000100:00100000:0.0:1782228958.845510:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782228958.845517:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329457792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228958.845550:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329457792:12345-0@lo:400:kworker.0 Request processed in 34us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228958.845556:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782228958.845588:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329457792:0@lo:400:kworker.0 00000100:00080000:3.0:1782228958.846156:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782228958.846755:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329458304:0@lo:400:kworker.0 00000100:00100000:2.0:1782228958.846805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228958.846834:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782228958.846840:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329458176:0@lo:400:kworker.0 00000100:00100000:2.0:1782228958.846871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228958.846903:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458176 00000100:00100000:2.0:1782228958.846908:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458176 00000100:00100000:1.0:1782228958.846968:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329458048:0@lo:400:kworker.0 00000100:00100000:1.0:1782228958.847002:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228958.847026:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782228958.847032:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329457920:0@lo:400:kworker.0 00000100:00100000:1.0:1782228958.847064:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228958.848729:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782228958.848746:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329458176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228958.848835:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329458176:12345-0@lo:400:kworker.0 Request processed in 95us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228958.848843:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1782228958.848887:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be39c00 x1868802329458176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228958.848902:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329458176:0@lo:400:kworker.0 00000100:00080000:3.0:1782228958.849653:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782228958.851014:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458304 00000100:00100000:0.0:1782228958.851028:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458304 00000100:00100000:3.0:1782228958.851148:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458048 00000100:00100000:3.0:1782228958.851154:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458048 00000100:00100000:0.0:1782228958.851221:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329457920 00000100:00100000:0.0:1782228958.851226:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329457920 00000100:00100000:0.0:1782228958.851245:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782228958.851254:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329458304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228958.851335:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329458304:12345-0@lo:400:kworker.0 Request processed in 82us (4529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228958.851342:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782228958.851357:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782228958.851364:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329457920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228958.851396:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329457920:12345-0@lo:400:kworker.0 Request processed in 33us (4330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228958.851403:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782228958.851473:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329458304:0@lo:400:kworker.0 00000100:00100000:0.0:1782228958.851518:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329457920:0@lo:400:kworker.0 00000100:00080000:1.0:1782228958.852501:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228958.859665:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782228958.859681:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329458048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228958.859781:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329458048:12345-0@lo:400:kworker.0 Request processed in 105us (12777us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228958.859788:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782228958.859850:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329458048:0@lo:400:kworker.0 00000100:00100000:1.0:1782228959.355980:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782228959.356006:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329458432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782228959.356079:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228959.356260:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458432 00000100:00100000:0.0:1782228959.356269:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458432 00000100:00100000:0.0:1782228959.356328:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782228959.356338:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329458432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782228959.356388:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228959.356461:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329458432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228959.356468:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1782228959.356597:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be39c00 x1868802329458432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228959.356616:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329458432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782228959.611820:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228959.814615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228959.814663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228959.814700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228959.814730:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228959.814753:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228959.814842:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502080 00000100:00100000:3.0:1782228959.814853:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502080 00000100:00100000:3.0:1782228959.814913:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 225 00000100:00100000:3.0:1782228959.814922:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2371:x1868802309502080:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228959.814996:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2371:x1868802309502080:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 74us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228959.815003:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 225 00000100:00100000:3.0:1782228959.815034:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502592 00000100:00100000:3.0:1782228959.815038:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502592 00000100:00100000:3.0:1782228959.815071:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502464 00000100:00100000:3.0:1782228959.815074:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502464 00000100:00100000:3.0:1782228959.815109:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:3.0:1782228959.815116:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309502592:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228959.815157:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309502592:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 41us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228959.815165:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:3.0:1782228959.815177:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:0.0:1782228959.815347:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502336 00000100:00100000:0.0:1782228959.815351:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502336 00000100:00100000:0.0:1782228959.815381:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502208 00000100:00100000:0.0:1782228959.815384:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502208 00000100:00100000:0.0:1782228959.815405:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 80 00000100:00100000:0.0:1782228959.815412:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309502336:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228959.815471:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309502336:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 59us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228959.815478:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 80 00000100:00100000:0.0:1782228959.815492:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00100000:0.0:1782228959.815498:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2371:x1868802309502208:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228959.815522:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2371:x1868802309502208:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 23us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228959.815528:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00080000:0.0:1782228959.815571:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782228959.815575:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782228959.815577:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782228959.816000:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309502464:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228959.816103:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309502464:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 860us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228959.816110:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 39 00010000:00010000:1.0:1782228960.638669:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228961.664782:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228962.683565:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228963.707540:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228963.963958:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329458560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228963.964106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228963.964274:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458560 00000100:00100000:2.0:1782228963.964282:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458560 00000100:00100000:2.0:1782228963.964352:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782228963.964374:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329458560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782228963.964411:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782228963.964498:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782228963.964795:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329458560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 422us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228963.964804:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782228963.964892:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329458816:0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.964927:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228963.964957:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782228963.964963:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329458688:0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.964991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228963.965031:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329459200:0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.965054:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228963.965126:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458816 00000100:00100000:2.0:1782228963.965131:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458816 00000100:00100000:2.0:1782228963.965170:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459200 00000100:00100000:2.0:1782228963.965174:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459200 00000100:00100000:2.0:1782228963.965197:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782228963.965203:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329458816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.965243:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329458816:12345-0@lo:400:kworker.0 Request processed in 40us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228963.965250:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782228963.965263:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782228963.965269:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329459200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.965305:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329459200:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228963.965311:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782228963.965345:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329459200:0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.965367:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329458816:0@lo:400:kworker.0 00000100:00100000:3.0:1782228963.965473:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329458944:0@lo:400:kworker.0 00000100:00100000:3.0:1782228963.965509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228963.965534:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228963.965540:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329459072:0@lo:400:kworker.0 00000100:00100000:3.0:1782228963.965561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228963.965587:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459072 00000100:00100000:3.0:1782228963.965590:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459072 00000100:00100000:3.0:1782228963.965618:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782228963.965624:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329459072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228963.965657:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329459072:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228963.965663:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1782228963.965676:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228963.965679:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782228963.965695:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe74e78e00 x1868802329459072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228963.965706:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329459072:0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.965772:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458944 00000100:00100000:2.0:1782228963.965776:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458944 00000100:00100000:2.0:1782228963.965808:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782228963.965818:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329458944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228963.965850:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329458944:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228963.965856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1782228963.965909:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228963.965926:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329458944:0@lo:400:kworker.0 00010000:00080000:0.0:1782228963.966315:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c63100 x1868802329458560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228963.966333:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329458560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228963.969210:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329458688 00000100:00100000:1.0:1782228963.969224:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329458688 00000100:00100000:1.0:1782228963.969295:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1782228963.969305:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329458688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228963.969402:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329458688:12345-0@lo:400:kworker.0 Request processed in 98us (4409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228963.969409:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1782228963.969489:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329458688:0@lo:400:kworker.0 00000100:00100000:2.0:1782228964.476651:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782228964.476676:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329459328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782228964.476744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228964.477126:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459328 00000100:00100000:0.0:1782228964.477135:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459328 00000100:00100000:0.0:1782228964.477188:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782228964.477198:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329459328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782228964.477252:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782228964.477299:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329459328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228964.477306:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1782228964.478494:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be39180 x1868802329459328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228964.478516:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329459328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782228964.732507:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228964.935329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228964.935422:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228964.935479:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228964.935505:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228964.935527:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228964.935569:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502720 00000100:00100000:1.0:1782228964.935598:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502720 00000100:00100000:0.0:1782228964.936046:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309503104 00000100:00100000:0.0:1782228964.936052:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309503104 00000100:00100000:0.0:1782228964.936095:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309503232 00000100:00100000:0.0:1782228964.936099:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309503232 00000100:00100000:0.0:1782228964.936141:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:0.0:1782228964.936154:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2369:x1868802309503104:12345-192.168.204.22@tcp:9:kworker.0 00000020:00000080:0.0:1782228964.936187:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e637f6 00000100:00080000:0.0:1782228964.936196:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe2f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782228964.936233:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1782228964.936661:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+2:2369:x1868802309503104:12345-192.168.204.22@tcp:9:kworker.0 Request processed in 509us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228964.936669:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:0.0:1782228964.936687:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:0.0:1782228964.936695:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe66070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2369:x1868802309503232:12345-192.168.204.22@tcp:9:kworker.0 00000020:00000080:0.0:1782228964.936709:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e637fd 00000100:00080000:0.0:1782228964.936715:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe77a86800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782228964.936741:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1782228964.936953:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe66070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4188f868-851e-4c26-a016-17a3b5288455+2:2369:x1868802309503232:12345-192.168.204.22@tcp:9:kworker.0 Request processed in 258us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228964.936969:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:1.0:1782228964.937445:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 227 00000100:00100000:1.0:1782228964.937456:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309502720:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228964.937490:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309502720:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 37us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228964.937498:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 227 00000100:00100000:1.0:1782228964.937548:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502976 00000100:00100000:1.0:1782228964.937554:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502976 00000100:00100000:1.0:1782228964.937608:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309502848 00000100:00100000:1.0:1782228964.937612:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309502848 00000100:00100000:1.0:1782228964.937634:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00100000:1.0:1782228964.937640:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309502976:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228964.937904:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 86 00000100:00100000:0.0:1782228964.937915:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309502848:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228964.937950:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309502848:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 37us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228964.937957:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 86 00000100:00080000:0.0:1782228964.937994:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782228964.937998:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782228964.938001:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782228964.938084:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228964.938582:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228964.938652:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309502976:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 1008us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228964.938661:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 85 00000001:00100000:1.0:1782228965.592668:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4188f868-851e-4c26-a016-17a3b5288455 00000020:00000080:1.0:1782228965.592680:0:7508:0:(genops.c:906:class_export_put()) final put ffff98fe77a80800/4188f868-851e-4c26-a016-17a3b5288455 00000020:00000080:0.0:1782228965.592842:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77a80800/4188f868-851e-4c26-a016-17a3b5288455 for lustre-OST0001 00000020:00000080:0.0:1782228965.592903:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe77a86800 for lustre-OST0001 00010000:00010000:3.0:1782228965.756042:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782228966.779849:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782228967.102072:0:10882:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782228967.804165:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228968.830063:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228969.083631:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329459712:0@lo:400:kworker.0 00000100:00100000:1.0:1782228969.083714:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228969.083771:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782228969.083777:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329459840:0@lo:400:kworker.0 00000100:00100000:1.0:1782228969.083804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228969.083843:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459712 00000100:00100000:1.0:1782228969.083851:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459712 00000100:00100000:1.0:1782228969.083928:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782228969.083937:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329459712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228969.083991:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329459712:12345-0@lo:400:kworker.0 Request processed in 55us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228969.083998:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782228969.084037:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459840 00000100:00100000:1.0:1782228969.084041:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459840 00000100:00100000:1.0:1782228969.084068:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782228969.084074:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329459840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228969.084106:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329459840:12345-0@lo:400:kworker.0 Request processed in 32us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228969.084111:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1782228969.084126:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782228969.084130:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782228969.084160:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73d15180 x1868802329459840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228969.084173:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329459840:0@lo:400:kworker.0 00000100:00100000:1.0:1782228969.084183:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329459712:0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.084561:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329459456:0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.084611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228969.084639:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329459968:0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.084663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228969.084707:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782228969.084714:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329459584:0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.084736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228969.084753:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329460096:0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.084775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228969.084802:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459968 00000100:00100000:3.0:1782228969.084805:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459968 00000100:00100000:3.0:1782228969.084833:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459584 00000100:00100000:3.0:1782228969.084835:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459584 00000100:00100000:3.0:1782228969.084859:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782228969.084867:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329459968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.084917:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329459968:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228969.084923:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782228969.084935:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782228969.084940:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329459584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.084968:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329459584:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228969.084974:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782228969.084996:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329460096 00000100:00100000:3.0:1782228969.084999:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329460096 00000100:00100000:3.0:1782228969.085023:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782228969.085029:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329460096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.085059:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329460096:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228969.085064:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1782228969.085083:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782228969.085092:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228969.085114:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329459584:0@lo:400:kworker.0 00010000:00080000:3.0:1782228969.085125:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73d15880 x1868802329460096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228969.085134:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329460096:0@lo:400:kworker.0 00000100:00100000:3.0:1782228969.085143:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329459968:0@lo:400:kworker.0 00000100:00100000:1.0:1782228969.087626:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329459456 00000100:00100000:1.0:1782228969.087640:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329459456 00000100:00100000:1.0:1782228969.087713:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782228969.087723:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329459456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228969.087810:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329459456:12345-0@lo:400:kworker.0 Request processed in 89us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228969.087817:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1782228969.089879:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329459456:0@lo:400:kworker.0 00000100:00100000:2.0:1782228969.090609:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782228969.090625:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329460224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782228969.090699:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228969.090988:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329460224 00000100:00100000:3.0:1782228969.090995:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329460224 00000100:00100000:3.0:1782228969.091047:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782228969.091055:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329460224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782228969.091092:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228969.091147:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329460224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228969.091154:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1782228969.091220:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c62680 x1868802329460224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228969.091238:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329460224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782228969.596232:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329460352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228969.596314:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228969.596391:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329460352 00000100:00100000:3.0:1782228969.596399:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329460352 00000100:00100000:3.0:1782228969.596461:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782228969.596471:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329460352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782228969.597736:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228969.597802:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329460352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1330us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228969.597810:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1782228969.601312:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be39880 x1868802329460352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228969.601345:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329460352:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1782228969.686781:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4188f868-851e-4c26-a016-17a3b5288455 00000020:00000080:3.0:1782228969.686791:0:6623:0:(genops.c:906:class_export_put()) final put ffff98fe7fe2d000/4188f868-851e-4c26-a016-17a3b5288455 00000020:00000080:3.0:1782228969.686816:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7fe2d000/4188f868-851e-4c26-a016-17a3b5288455 for lustre-OST0000 00000020:00000080:3.0:1782228969.686860:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7fe2f800 for lustre-OST0000 00010000:00010000:0.0:1782228969.854478:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228970.048555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228970.048597:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228970.048622:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228970.048655:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309503616 00000100:00100000:3.0:1782228970.048665:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309503616 00000100:00100000:3.0:1782228970.048720:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309503488 00000100:00100000:3.0:1782228970.048723:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309503488 00000100:00100000:3.0:1782228970.048745:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 90 00000100:00100000:3.0:1782228970.048755:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309503616:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228970.048830:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309503616:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 77us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228970.048838:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 90 00000100:00100000:3.0:1782228970.048856:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 91 00000100:00100000:3.0:1782228970.048862:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309503488:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228970.048899:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309503488:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 37us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228970.048906:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 91 00000100:00080000:3.0:1782228970.048924:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228970.049335:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309503360 00000100:00100000:2.0:1782228970.049340:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309503360 00000100:00100000:2.0:1782228970.049395:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 229 00000100:00100000:2.0:1782228970.049403:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309503360:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228970.049457:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309503360:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 55us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228970.049463:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 229 00010000:00010000:0.0:1782228970.876842:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782228971.148132:0:11032:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefeb14930 20000000:00000080:3.0:1782228971.148151:0:11032:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fe50214000 uarg=0000000000000000 20000000:01000000:3.0:1782228971.148240:0:11032:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782228971.148245:0:11032:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782228971.148250:0:11032:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1782228971.152677:0:11033:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1782228971.152844:0:11032:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782228971.160895:0:11032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782228971.160924:0:11032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.160944:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.160954:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.160962:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.160968:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.160975:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.160982:0:11032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.161020:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.161036:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 12 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228971.161051:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460480:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782228971.161232:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.161251:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 18 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228971.161261:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460608:0@lo:104: 00000100:00100000:3.0:1782228971.161299:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782228971.161322:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.161329:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 18 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228971.161337:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460736:0@lo:104: 00000100:00100000:3.0:1782228971.161352:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228971.161378:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329460608 00000100:00100000:3.0:1782228971.161383:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329460608 00000100:00100000:2.0:1782228971.161601:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782228971.161611:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11032:x1868802329460608:12345-0@lo:104: 00010000:00010000:2.0:1782228971.161622:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228971.161664:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782228971.161669:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11032:x1868802329460608:12345-0@lo:104: Request processed in 61us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228971.161675:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1782228971.162499:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228971.162507:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 18 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228971.162514:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460864:0@lo:104: 00000100:00100000:2.0:1782228971.162536:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228971.162553:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329460864 00000100:00100000:2.0:1782228971.162557:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329460864 00000100:00100000:2.0:1782228971.162572:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782228971.162576:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11032:x1868802329460864:12345-0@lo:104: 00010000:00010000:2.0:1782228971.162582:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228971.162613:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782228971.162617:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11032:x1868802329460864:12345-0@lo:104: Request processed in 41us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228971.162621:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1782228971.162644:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228971.162650:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 12 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228971.162656:0:11032:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460992:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782228971.162682:0:11032:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782228971.162697:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460608:0@lo:104: 00000100:00100000:2.0:1782228971.162702:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460864:0@lo:104: 00000100:00100000:3.0:1782228971.162823:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329460736 00000100:00100000:3.0:1782228971.162828:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329460736 00010000:00010000:0.0:1782228971.162832:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782228971.162838:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.162852:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe605b3c00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228971.162865:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228971.162870:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1782228971.162874:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228971.162877:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11032:x1868802329460736:12345-0@lo:104: 10000000:00010000:0.0:1782228971.162882:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.162885:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228971.162888:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782228971.162916:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.162919:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1782228971.162923:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782228971.162924:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11032:x1868802329460736:12345-0@lo:104: Request processed in 49us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228971.162929:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1782228971.162940:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.162947:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe605b3c00/0x8e1c8a3488e637cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637d3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.162959:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782228971.162962:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.162967:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82051400 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228971.162970:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.162986:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228971.162993:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228971.163579:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c60000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460736:0@lo:104: 00000100:00100000:1.0:1782228971.163689:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782228971.163702:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329461120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782228971.163750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1782228971.163892:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782228971.163914:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.163921:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228971.163935:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.163942:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051400/0x8e1c8a3488e637b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637b7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.163952:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228971.163956:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.163962:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228971.163965:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.163972:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228971.163979:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228971.163990:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782228971.164015:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.164021:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228971.164036:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.164043:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e637be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e637c5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.164057:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228971.164058:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228971.164070:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228971.164088:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329461120 00000100:00100000:0.0:1782228971.164093:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329461120 00010000:00010000:0.0:1782228971.164114:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 19 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228971.164137:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782228971.164145:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329461120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782228971.164156:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228971.164161:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 19 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.164170:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 19 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.164183:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b2200/0x8e1c8a3488e637d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e637cc expref: 19 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.164202:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228971.164229:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3309:x1868802329461120:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228971.164236:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782228971.169384:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782228971.169421:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329461248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782228971.169536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228971.169601:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329461248 00000100:00100000:1.0:1782228971.169609:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329461248 00010000:00010000:1.0:1782228971.169648:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 18 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228971.169682:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782228971.169692:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3308:x1868802329461248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782228971.169705:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782228971.169711:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 18 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.169722:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 18 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.169740:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e637b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e637b0 expref: 18 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.169757:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782228971.169793:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3308:x1868802329461248:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228971.169801:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782228971.169845:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329461120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782228971.169890:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329461248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782228971.170950:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460480:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782228971.170964:0:11032:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1868802329460992:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782228971.171020:0:11032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228971.171300:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228971.171321:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228971.172289:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782228971.172321:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329461376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782228971.172376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228971.172743:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329461376 00000100:00100000:3.0:1782228971.172751:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329461376 00010000:00010000:3.0:1782228971.172795:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 17 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228971.172820:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782228971.172829:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3311:x1868802329461376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782228971.172843:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228971.172849:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 17 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.172871:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 17 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.172887:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e637c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e637be expref: 17 pid: 5790 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.172901:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228971.172942:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3311:x1868802329461376:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228971.172950:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782228971.173157:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329461376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782228971.173364:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228971.173405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228971.173577:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309503744 00000100:00100000:1.0:1782228971.173581:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309503744 00010000:00010000:1.0:1782228971.173599:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 13 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228971.173612:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309503872 00000100:00100000:1.0:1782228971.173614:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309503872 00010000:00010000:1.0:1782228971.173625:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 14 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228971.173637:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 28 00000100:00100000:1.0:1782228971.173643:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+14:2372:x1868802309503744:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782228971.173652:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782228971.173656:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 14 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173667:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 14 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173679:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82050600/0x8e1c8a3488e637e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994968c expref: 14 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173688:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782228971.173724:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309503744:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 81us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228971.173731:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 28 00000100:00100000:1.0:1782228971.173753:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 29 00000100:00100000:1.0:1782228971.173759:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:2372:x1868802309503872:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782228971.173766:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782228971.173770:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 12 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173780:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 12 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173790:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b3a00/0x8e1c8a3488e637a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949654 expref: 12 pid: 5790 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173801:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173809:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173824:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173831:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173837:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173844:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173850:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782228971.173871:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173880:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173894:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228971.173904:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782228971.173925:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:2372:x1868802309503872:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 166us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228971.173932:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 29 00010000:00010000:3.0:1782228971.174131:0:11032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.174140:0:11032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228971.174154:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e63804 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228971.899676:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228972.865897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228972.866319:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504000 00000100:00100000:2.0:1782228972.866333:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504000 00000100:00100000:2.0:1782228972.866408:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 230 00000100:00100000:2.0:1782228972.866419:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:5586:x1868802309504000:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228972.866472:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228972.866510:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496b6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228972.866545:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228972.866578:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228972.866589:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd600, rc 0) 00000100:00100000:2.0:1782228972.866659:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309504000:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 242us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228972.866667:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 230 00000100:00100000:1.0:1782228972.882018:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228972.882913:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504128 00000100:00100000:0.0:1782228972.882927:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504128 00000100:00100000:0.0:1782228972.883028:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 231 00000100:00100000:0.0:1782228972.883040:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309504128:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228972.883667:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309504128:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 627us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228972.883676:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 231 00000100:00100000:1.0:1782228972.903802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228972.907901:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504256 00000100:00100000:0.0:1782228972.907922:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504256 00000100:00100000:2.0:1782228972.910133:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 232 00000100:00100000:2.0:1782228972.910150:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309504256:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228972.911157:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309504256:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 Request processed in 1003us (7362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228972.911169:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 232 00000100:00100000:1.0:1782228972.922312:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228972.922547:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504384 00000100:00100000:0.0:1782228972.922560:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504384 00000100:00100000:0.0:1782228972.922632:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 233 00000100:00100000:0.0:1782228972.922644:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309504384:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228972.922669:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228972.922694:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496bd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228972.922733:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228972.922746:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228972.922776:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031a00, rc 0) 00000100:00100000:0.0:1782228972.922881:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309504384:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 239us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228972.922889:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 233 00010000:00010000:2.0:1782228972.925610:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228972.927554:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228972.928036:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504512 00000100:00100000:2.0:1782228972.928050:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504512 00000100:00100000:2.0:1782228972.928134:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 234 00000100:00100000:2.0:1782228972.928146:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309504512:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228972.931879:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309504512:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 3720us (4322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228972.931895:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 234 00000100:00100000:3.0:1782228972.942666:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228972.942957:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504640 00000100:00100000:1.0:1782228972.942970:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504640 00000100:00100000:1.0:1782228972.943060:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 235 00000100:00100000:1.0:1782228972.943072:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309504640:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228972.943409:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309504640:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 Request processed in 338us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228972.943419:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 235 10000000:01000000:2.0:1782228973.115546:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782228973.115556:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7fe6d000 from 7 10000000:01000000:2.0:1782228973.115563:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782228973.115621:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.115645:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.115658:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228973.115691:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782228973.115783:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228973.115861:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782228973.117643:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329461504 00000100:00100000:1.0:1782228973.117659:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329461504 00000100:00100000:1.0:1782228973.117782:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1782228973.117794:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329461504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782228973.117843:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228973.117866:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63819 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228973.117903:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228973.117915:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228973.117925:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421400, rc 0) 00000100:00100000:1.0:1782228973.118031:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329461504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228973.118039:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1782228973.126993:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228973.127041:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.127056:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228973.127188:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228973.127267:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228973.136761:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782228973.136925:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329461632 00000100:00100000:1.0:1782228973.136938:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329461632 00000100:00100000:1.0:1782228973.137418:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782228973.137452:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329461632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228973.138404:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228973.138557:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228973.138618:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228973.138646:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782228973.138667:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329461760 00000100:00100000:2.0:1782228973.138673:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329461760 00000100:00100000:2.0:1782228973.138712:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1782228973.138718:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329461760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228973.138906:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329461760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228973.138915:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1782228973.138981:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228973.140048:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329461632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 529us (10690us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228973.140340:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000040:00080000:2.0:1782228973.141637:0:11076:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782228973.145412:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782228973.145579:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782228973.145596:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228973.145612:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782228973.145653:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782228973.145656:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7b8d6000 from 7 10000000:01000000:1.0:1782228973.145659:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782228973.145718:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228973.145726:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228973.145738:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228973.145771:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782228973.145870:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228973.145981:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc0840 going to sleep for 11 seconds 00000100:00100000:2.0:1782228973.146158:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329461888 00000100:00100000:2.0:1782228973.146225:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329461888 00000100:00100000:2.0:1782228973.146352:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1782228973.146364:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329461888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228973.146379:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228973.146395:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63827 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.146427:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.146571:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.146580:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcca00, rc 0) 00000100:00100000:2.0:1782228973.146675:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329461888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228973.146683:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782228973.146762:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329461888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782228973.146780:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228973.146790:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228973.146864:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228973.146893:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228973.146915:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc0840 going to sleep for 11 seconds 00000100:00100000:1.0:1782228973.146931:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462016 00000100:00100000:1.0:1782228973.146934:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462016 00000100:00100000:1.0:1782228973.147271:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1782228973.147288:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329462016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228973.147682:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329462016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 401us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228973.147689:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1782228973.147853:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228973.147890:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228973.147932:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228973.147949:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc0840 going to sleep for 11 seconds 00000100:00100000:0.0:1782228973.148872:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462144 00000100:00100000:0.0:1782228973.148881:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462144 00000100:00100000:0.0:1782228973.148923:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782228973.148930:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329462144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228973.149260:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329462144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228973.149268:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782228973.151405:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782228973.154914:0:11077:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782228973.155260:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782228973.155287:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782228973.155304:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228973.155319:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228973.155333:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782228973.155336:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe50300000 from 7 10000000:01000000:0.0:1782228973.155339:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782228973.155390:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228973.155399:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228973.155418:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228973.155466:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782228973.155559:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228973.155607:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6f201240 going to sleep for 11 seconds 00000100:00100000:0.0:1782228973.155637:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462272 00000100:00100000:0.0:1782228973.155644:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462272 00000100:00100000:0.0:1782228973.155705:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782228973.155714:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329462272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228973.155731:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228973.155746:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63835 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228973.155774:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228973.155786:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228973.155796:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030200, rc 0) 00000100:00100000:0.0:1782228973.155851:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329462272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228973.155859:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782228973.155919:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228973.155936:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228973.155951:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228973.156010:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228973.156036:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228973.156049:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41e653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228973.156062:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462400 00000100:00100000:0.0:1782228973.156065:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462400 00000100:00100000:0.0:1782228973.156085:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782228973.156092:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329462400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228973.156399:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329462400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228973.156406:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782228973.156450:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228973.156479:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228973.156521:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228973.156534:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41e653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782228973.156547:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462528 00000100:00100000:0.0:1782228973.156550:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462528 00000100:00100000:0.0:1782228973.156570:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1782228973.156577:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329462528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228973.156765:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329462528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228973.156772:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1782228973.156862:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329462528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782228973.162348:0:11080:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782228973.165166:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782228973.165217:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782228973.165231:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.165247:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228973.947675:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228974.205229:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782228974.205262:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329462656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228974.205373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228974.205490:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462656 00000100:00100000:1.0:1782228974.205500:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462656 00000100:00100000:0.0:1782228974.206404:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329462784:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.206478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228974.206509:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329463296:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.206536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228974.206559:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782228974.206564:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329462912:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.206583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228974.206610:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329463168:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.206633:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228974.206652:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782228974.206657:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329463040:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.206677:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228974.206707:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462784 00000100:00100000:0.0:1782228974.206713:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462784 00000100:00100000:0.0:1782228974.206765:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782228974.206775:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329462784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.206849:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329462784:12345-0@lo:400:kworker.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228974.206857:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782228974.206897:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463296 00000100:00100000:0.0:1782228974.206900:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463296 00000100:00100000:1.0:1782228974.211092:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782228974.211114:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329462656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228974.211171:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228974.211281:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329462656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (5908us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228974.211289:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782228974.211348:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463168 00000100:00100000:1.0:1782228974.211370:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463168 00000100:00100000:0.0:1782228974.211805:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329462912 00000100:00100000:0.0:1782228974.211812:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329462912 00000100:00100000:0.0:1782228974.211831:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463040 00000100:00100000:0.0:1782228974.211834:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463040 00000100:00100000:0.0:1782228974.211852:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782228974.211859:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329463296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.211926:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329463296:12345-0@lo:400:kworker.0 Request processed in 67us (5389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228974.211944:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782228974.211959:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782228974.211964:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329462912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.211989:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329462912:12345-0@lo:400:kworker.0 Request processed in 26us (5405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228974.212008:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782228974.212019:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782228974.212025:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329463040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.212061:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329463040:12345-0@lo:400:kworker.0 Request processed in 37us (5382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228974.212077:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782228974.212137:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329463040:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.212178:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329462912:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.212190:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329462784:0@lo:400:kworker.0 00000100:00100000:0.0:1782228974.212202:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329463296:0@lo:400:kworker.0 00010000:00080000:0.0:1782228974.212268:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73d15500 x1868802329462656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228974.212286:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329462656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228974.212541:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782228974.212550:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329463168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228974.212603:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329463168:12345-0@lo:400:kworker.0 Request processed in 55us (5968us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228974.212610:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1782228974.212641:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c8b800 x1868802329463168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228974.212653:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329463168:0@lo:400:kworker.0 00000100:00080000:3.0:1782228974.217974:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228974.217990:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782228974.217994:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782228974.715893:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329463424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782228974.715987:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228974.716280:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463424 00000100:00100000:2.0:1782228974.716290:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463424 00000100:00100000:2.0:1782228974.716345:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782228974.716355:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329463424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228974.716396:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228974.716480:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329463424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228974.716488:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1782228974.716532:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be39f80 x1868802329463424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228974.716550:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329463424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228974.972634:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228975.174381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228975.174585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228975.174622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228975.174648:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504896 00000100:00100000:3.0:1782228975.174657:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504896 00000100:00100000:3.0:1782228975.174715:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309505024 00000100:00100000:3.0:1782228975.174719:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309505024 00000100:00100000:3.0:1782228975.174742:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 95 00000100:00100000:3.0:1782228975.174752:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309504896:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228975.174830:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 96 00000100:00100000:2.0:1782228975.174840:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309505024:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228975.174841:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309504896:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 91us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228975.174848:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 95 00000100:00080000:3.0:1782228975.174869:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228975.174869:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309505024:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228975.174875:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 96 00000100:00100000:0.0:1782228975.184110:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309504768 00000100:00100000:0.0:1782228975.184125:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309504768 00000100:00100000:0.0:1782228975.184202:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 246 00000100:00100000:0.0:1782228975.184214:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309504768:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228975.184294:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309504768:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 82us (9924us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228975.184302:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 246 00010000:00010000:2.0:1782228975.997198:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782228976.878034:0:11232:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782228977.019628:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228978.046832:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228979.068857:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228979.324726:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329463680:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.324800:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228979.324845:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329464192:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.324871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228979.324905:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782228979.324911:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329463552:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.324936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228979.324952:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329464064:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.324984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228979.325006:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329463808:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.325051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228979.325068:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228979.325074:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329463936:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.325092:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228979.325120:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463680 00000100:00100000:3.0:1782228979.325127:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463680 00000100:00100000:3.0:1782228979.325165:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464064 00000100:00100000:3.0:1782228979.325168:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464064 00000100:00100000:3.0:1782228979.325188:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463808 00000100:00100000:3.0:1782228979.325190:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463808 00000100:00100000:3.0:1782228979.325207:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782228979.325215:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329463680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.325262:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329463680:12345-0@lo:400:kworker.0 Request processed in 47us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228979.325269:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782228979.325284:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782228979.325290:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329464064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.325313:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329464064:12345-0@lo:400:kworker.0 Request processed in 23us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228979.325318:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782228979.325342:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782228979.325354:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329463808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228979.325803:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782228979.325813:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329464320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228979.325844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228979.325872:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464320 00000100:00100000:1.0:1782228979.325876:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464320 00000100:00100000:1.0:1782228979.325904:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782228979.325911:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329464320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228979.325939:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228979.325973:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329464320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228979.325979:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1782228979.326010:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73d14000 x1868802329464320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228979.326027:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329464320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782228979.326140:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329463808:12345-0@lo:400:kworker.0 Request processed in 787us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228979.326146:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782228979.326165:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464192 00000100:00100000:3.0:1782228979.326169:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464192 00000100:00100000:3.0:1782228979.326186:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463936 00000100:00100000:3.0:1782228979.326189:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463936 00000100:00100000:3.0:1782228979.326207:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782228979.326213:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329464192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.326241:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329464192:12345-0@lo:400:kworker.0 Request processed in 28us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228979.326247:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782228979.326258:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782228979.326263:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329463936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.326287:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329463936:12345-0@lo:400:kworker.0 Request processed in 24us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228979.326293:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1782228979.326332:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228979.326336:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782228979.326339:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228979.326359:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329464064:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.326370:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329463680:0@lo:400:kworker.0 00010000:00080000:3.0:1782228979.326390:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe74e78700 x1868802329464192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228979.326400:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329464192:0@lo:400:kworker.0 00010000:00080000:3.0:1782228979.326452:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe74e7ad80 x1868802329463936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782228995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228979.326461:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329463936:0@lo:400:kworker.0 00000100:00100000:3.0:1782228979.326472:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329463808:0@lo:400:kworker.0 00000100:00100000:0.0:1782228979.326670:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329463552 00000100:00100000:0.0:1782228979.326674:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329463552 00000100:00100000:0.0:1782228979.326715:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1782228979.326722:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329463552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228979.326761:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329463552:12345-0@lo:400:kworker.0 Request processed in 40us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228979.326774:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1782228979.326819:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329463552:0@lo:400:kworker.0 00000100:00100000:1.0:1782228979.835725:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329464448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782228979.835801:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228979.836032:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464448 00000100:00100000:2.0:1782228979.836040:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464448 00000100:00100000:2.0:1782228979.836094:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782228979.836104:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329464448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228979.836154:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228979.836218:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329464448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228979.836225:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1782228979.836311:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be39f80 x1868802329464448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782228995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228979.836356:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329464448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228980.091580:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228980.286627:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228980.286703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228980.286715:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309505280 00000100:00100000:2.0:1782228980.286724:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309505280 00000100:00100000:3.0:1782228980.286729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228980.286790:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309505408 00000100:00100000:3.0:1782228980.286813:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309505408 00000100:00100000:3.0:1782228980.286908:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 100 00000100:00100000:3.0:1782228980.286920:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309505408:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228980.287047:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309505408:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 129us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228980.287645:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 101 00000100:00100000:2.0:1782228980.287657:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309505280:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228980.287710:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309505280:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 57us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228980.287718:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 101 00000100:00100000:2.0:1782228980.287744:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309505152 00000100:00100000:2.0:1782228980.287749:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309505152 00000100:00100000:2.0:1782228980.287778:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 248 00000100:00100000:2.0:1782228980.287784:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309505152:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782228980.287807:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309505152:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 23us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228980.287813:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 248 00000100:00080000:2.0:1782228980.287838:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228980.289129:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 100 00000001:02000400:3.0:1782228980.539929:0:11331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:36:19 (1782228979) === 00000100:00100000:3.0:1782228981.000926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.000987:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.001007:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309505536 00000100:00100000:0.0:1782228981.001016:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309505536 00000100:00100000:0.0:1782228981.001079:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:0.0:1782228981.001154:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309505536:12345-192.168.204.22@tcp:41:mkdir.0 00000100:00100000:2.0:1782228981.001184:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309505664 00000100:00100000:2.0:1782228981.001188:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309505664 00000004:00000024:0.0:1782228981.001201:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782228981.001227:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:2.0:1782228981.001234:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9689:x1868802309505664:12345-192.168.204.22@tcp:700:mkdir.0 00000100:00100000:2.0:1782228981.001316:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9689:x1868802309505664:12345-192.168.204.22@tcp:700:mkdir.0 Request processed in 81us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228981.001323:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:0.0:1782228981.002769:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309505536:12345-192.168.204.22@tcp:41:mkdir.0 Request processed in 1674us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228981.002780:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:3.0:1782228981.011548:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.016043:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309505920 00000100:00100000:0.0:1782228981.016057:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309505920 00000100:00100000:0.0:1782228981.016176:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:0.0:1782228981.016187:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:9689:x1868802309505920:12345-192.168.204.22@tcp:36:mkdir.0 00010000:00010000:0.0:1782228981.016243:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228981.016328:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe605b2a00/0x8e1c8a3488e63724 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994963f expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.016352:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:0.0:1782228981.016363:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782228981.016741:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.016755:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.016766:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.016796:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.016815:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.016823:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782228981.019223:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782228981.019238:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.019259:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.019266:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.019272:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.019277:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.019285:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.019298:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9c00) 00010000:00010000:0.0:1782228981.019301:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782228981.019304:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.019310:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63843 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782228981.019329:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dec0e874 reply state 00000000b7f0b0ff transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228981.019337:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782228981.019516:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9689:x1868802309505920:12345-192.168.204.22@tcp:36:mkdir.0 Request processed in 3327us (7972us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782228981.019525:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00010000:00010000:0.0:1782228981.027143:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.027180:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.027187:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.027194:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.027210:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.027218:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.027315:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98fe42cb9700) 00010000:00010000:0.0:1782228981.027319:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782228981.027324:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.027331:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6384a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228981.033711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.033814:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309506048 00000100:00100000:0.0:1782228981.033824:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309506048 00000100:00100000:0.0:1782228981.033918:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:0.0:1782228981.033928:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:9690:x1868802309506048:12345-192.168.204.22@tcp:101:chmod.0 00010000:00010000:0.0:1782228981.033950:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228981.033971:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496c4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.034060:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63858 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.034075:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63858 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.034086:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63858 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782228981.034149:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782228981.034153:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782228981.034197:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63858 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.034225:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496c4 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.034241:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63858 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496c4 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.034250:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9c00) 00010000:00010000:0.0:1782228981.034254:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782228981.034257:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031800, rc 0) 00000100:00100000:0.0:1782228981.034368:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9690:x1868802309506048:12345-192.168.204.22@tcp:101:chmod.0 Request processed in 440us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228981.034375:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:2.0:1782228981.036650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.036734:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309506304 00000100:00100000:3.0:1782228981.036742:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309506304 00000100:00100000:3.0:1782228981.036792:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:3.0:1782228981.036801:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9690:x1868802309506304:12345-192.168.204.22@tcp:36:chmod.0 00010000:00010000:3.0:1782228981.036850:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228981.036884:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63858 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496c4 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.036923:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9c00) 00010000:00010000:3.0:1782228981.036934:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782228981.036957:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.036968:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.036978:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782228981.037299:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009082954 reply state 000000000231d93c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228981.037309:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782228981.037325:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1782228981.037406:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+8:9690:x1868802309506304:12345-192.168.204.22@tcp:36:chmod.0 Request processed in 605us (764us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782228981.037413:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00010000:00010000:2.0:1782228981.039486:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.039500:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.039507:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.039513:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782228981.039517:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.039524:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.039537:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43933000) 00010000:00010000:2.0:1782228981.039540:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782228981.039544:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.039550:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6385f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228981.062214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.062301:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309506432 00000100:00100000:3.0:1782228981.062312:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309506432 00000100:00100000:3.0:1782228981.062415:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:3.0:1782228981.062425:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9691:x1868802309506432:12345-192.168.204.22@tcp:101:chown.0 00010000:00010000:3.0:1782228981.062499:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228981.062524:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63866 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496cb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.062587:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e6386d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.062613:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e6386d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.062625:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e6386d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782228981.062699:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1782228981.062703:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782228981.062883:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e6386d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.062912:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63866 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496cb expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.062931:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e6386d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496cb expref: 8 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.062940:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43933f00) 00010000:00010000:3.0:1782228981.062942:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782228981.062945:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916a00, rc 0) 00000100:00100000:3.0:1782228981.062998:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:9691:x1868802309506432:12345-192.168.204.22@tcp:101:chown.0 Request processed in 574us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228981.063005:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:1.0:1782228981.067057:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.067141:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309506560 00000100:00100000:0.0:1782228981.067150:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309506560 00000100:00100000:0.0:1782228981.067227:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:0.0:1782228981.067237:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:9691:x1868802309506560:12345-192.168.204.22@tcp:101:chown.0 00010000:00010000:0.0:1782228981.067256:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228981.067276:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496d2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067338:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067352:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067363:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067379:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067386:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067393:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067519:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067527:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067533:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782228981.067581:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782228981.067584:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782228981.067606:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067616:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067622:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067627:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067632:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.067636:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067641:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067652:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43933f00) 00010000:00010000:0.0:1782228981.067655:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782228981.067659:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067675:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6387b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067688:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067703:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067719:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067724:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.067727:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067733:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067741:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98fe42cb9700) 00010000:00010000:0.0:1782228981.067743:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782228981.067746:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067751:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63882 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067782:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e63874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496d2 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067795:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496d2 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.067802:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782228981.067805:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782228981.067813:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe414a0000, rc 0) 00000100:00100000:0.0:1782228981.067867:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:9691:x1868802309506560:12345-192.168.204.22@tcp:101:chown.0 Request processed in 630us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228981.067874:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:1.0:1782228981.073029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.073697:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309506816 00000100:00100000:3.0:1782228981.073795:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309506816 00000100:00100000:3.0:1782228981.073890:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:3.0:1782228981.073899:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+9:9691:x1868802309506816:12345-192.168.204.22@tcp:36:chown.0 00010000:00010000:3.0:1782228981.073953:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228981.073991:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496d2 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.074013:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:3.0:1782228981.074024:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782228981.074049:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.074062:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.074072:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782228981.099551:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1782228981.099568:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1782228981.099640:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d645ffb reply state 000000008332a73c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228981.099681:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782228981.099816:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1782228981.099927:0:5798:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782228981.099947:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9691:x1868802309506816:12345-192.168.204.22@tcp:36:chown.0 Request processed in 26046us (26925us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782228981.099957:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 20 00010000:00010000:2.0:1782228981.099990:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.099998:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.100005:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.100011:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782228981.100016:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.100024:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.100038:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933c00) 00010000:00010000:2.0:1782228981.100041:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782228981.100045:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.100051:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63890 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.115677:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228981.139674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.139762:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309506944 00000100:00100000:0.0:1782228981.139772:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309506944 00000100:00100000:0.0:1782228981.139845:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00100000:0.0:1782228981.139856:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:9692:x1868802309506944:12345-192.168.204.22@tcp:101:touch.500 00010000:00010000:0.0:1782228981.139882:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228981.139903:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63897 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496d9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782228981.141148:0:5796:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1181us 00010000:00010000:3.0:1782228981.164712:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.164803:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.164818:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.164836:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.164842:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.164849:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165327:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e638ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165569:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e638ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165578:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e638ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782228981.165677:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782228981.165681:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782228981.165841:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e638ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165854:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165860:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165867:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165873:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782228981.165877:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165883:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165895:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43933f00) 00010000:00010000:3.0:1782228981.165904:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782228981.165909:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165916:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6389e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165927:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165932:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165939:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165944:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782228981.165947:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165953:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165961:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98fe43933700) 00010000:00010000:3.0:1782228981.165963:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782228981.165965:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.165971:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.166010:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63897 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496d9 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.166037:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e638ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496d9 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.166045:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:3.0:1782228981.166048:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782228981.166050:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916e00, rc 0) 00000100:00100000:3.0:1782228981.166125:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9692:x1868802309506944:12345-192.168.204.22@tcp:101:touch.500 Request processed in 26269us (26476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228981.166134:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00100000:2.0:1782228981.169216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.169288:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309507200 00000100:00100000:0.0:1782228981.169297:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309507200 00000100:00100000:0.0:1782228981.169353:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:0.0:1782228981.169363:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9692:x1868802309507200:12345-192.168.204.22@tcp:101:touch.500 00010000:00010000:0.0:1782228981.169383:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228981.169401:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e638b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496e0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.170091:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.170111:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.170123:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.170196:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.170205:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.170211:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782228981.172525:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1782228981.175395:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175420:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175450:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175495:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175502:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175508:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175514:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a0c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782228981.175519:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175538:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175550:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:3.0:1782228981.175553:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782228981.175558:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175563:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e638ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782228981.175578:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d21fdf32 reply state 000000003b66da06 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228981.175587:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782228981.175712:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e638b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496e0 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175932:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496e0 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.175941:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe43933700) 00010000:00010000:3.0:1782228981.175943:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782228981.175946:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917200, rc 0) 00000100:00100000:3.0:1782228981.176075:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+10:9692:x1868802309507200:12345-192.168.204.22@tcp:101:touch.500 Request processed in 6712us (6866us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782228981.176084:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22 00010000:00010000:2.0:1782228981.179222:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.179238:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.179245:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.179251:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a1a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782228981.179256:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.179263:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.179286:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff98fe42cb9700) 00010000:00010000:2.0:1782228981.179290:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782228981.179294:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.179301:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228981.193148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.193206:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309507456 00000100:00100000:3.0:1782228981.193231:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309507456 00000100:00100000:3.0:1782228981.193291:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:3.0:1782228981.193302:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+9:9692:x1868802309507456:12345-192.168.204.22@tcp:36:touch.500 00010000:00010000:3.0:1782228981.193550:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228981.193590:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496e0 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.193609:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe43933700) 00010000:00010000:3.0:1782228981.193620:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782228981.193677:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.193691:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.193700:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782228981.194127:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad304aad reply state 00000000a000d20c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228981.194136:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782228981.194231:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+10:9692:x1868802309507456:12345-192.168.204.22@tcp:36:touch.500 Request processed in 929us (1092us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782228981.194238:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 23 00010000:00010000:2.0:1782228981.198952:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.198969:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.198996:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.199003:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782228981.199008:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.199017:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.199033:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe43933600) 00010000:00010000:2.0:1782228981.199037:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782228981.199041:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.199048:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e638d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228981.201396:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.201471:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309507584 00000100:00100000:3.0:1782228981.201483:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309507584 00000100:00100000:3.0:1782228981.201533:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:3.0:1782228981.201592:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+9:9692:x1868802309507584:12345-192.168.204.22@tcp:101:touch.500 00010000:00010000:3.0:1782228981.201635:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228981.201656:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e638dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496e7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.201728:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e638dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496e7 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.201744:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e638dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496e7 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.201764:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe43933c00) 00010000:00010000:3.0:1782228981.201769:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782228981.201772:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916800, rc 0) 00000100:00100000:3.0:1782228981.201844:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+10:9692:x1868802309507584:12345-192.168.204.22@tcp:101:touch.500 Request processed in 301us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228981.201854:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:1.0:1782228981.206171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.206257:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309507712 00000100:00100000:3.0:1782228981.206267:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309507712 00000100:00100000:3.0:1782228981.206316:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:3.0:1782228981.206324:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2369:x1868802309507712:12345-192.168.204.22@tcp:8:touch.500 00010000:00080000:3.0:1782228981.206361:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:3.0:1782228981.206392:0:6599:0:(genops.c:1406:class_connect()) connect: client 2d74cab1-6977-468d-a933-6ac020ef49f3, cookie 0x8e1c8a3488e638e4 00002000:00100000:3.0:1782228981.206404:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2d74cab1-6977-468d-a933-6ac020ef49f3/ffff98fe77c5b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782228981.206506:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782228981.206765:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782228981.206794:0:6599:0:(import.c:65:import_set_state_nolock()) ffff98fe77c59000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782228981.207064:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2369:x1868802309507712:12345-192.168.204.22@tcp:8:touch.500 Request processed in 738us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228981.207073:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:2.0:1782228981.211463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228981.211533:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309507840 00000100:00100000:1.0:1782228981.211542:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309507840 00000100:00100000:1.0:1782228981.211689:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00080000:2.0:1782228981.211698:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782228981.211704:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:0:x1868802309507840:12345-192.168.204.22@tcp:2:touch.500 00000001:00080000:0.0:1782228981.253282:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1782228981.253300:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000100:00100000:3.0:1782228981.253498:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:0:x1868802309507840:12345-192.168.204.22@tcp:2:touch.500 Request processed in 41792us (42067us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782228981.253509:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:2.0:1782228981.256020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.256103:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309508096 00000100:00100000:0.0:1782228981.256113:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309508096 00000100:00100000:0.0:1782228981.256167:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:0.0:1782228981.256177:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+10:9692:x1868802309508096:12345-192.168.204.22@tcp:35:touch.500 00000100:00100000:0.0:1782228981.256552:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+11:9692:x1868802309508096:12345-192.168.204.22@tcp:35:touch.500 Request processed in 375us (538us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782228981.256560:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:1.0:1782228981.297789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.298138:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309508224 00000100:00100000:0.0:1782228981.298147:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309508224 00000100:00100000:0.0:1782228981.298240:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:0.0:1782228981.298249:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+11:9693:x1868802309508224:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:0.0:1782228981.298272:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228981.298289:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e638eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496ee expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.298351:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.298376:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.298386:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782228981.298471:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782228981.298474:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782228981.298510:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.298533:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e638eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496ee expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.298553:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496ee expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.298561:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:0.0:1782228981.298564:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782228981.298567:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe414a1a00, rc 0) 00000100:00100000:0.0:1782228981.298631:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+12:9693:x1868802309508224:12345-192.168.204.22@tcp:101:rm.0 Request processed in 383us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228981.298638:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:1.0:1782228981.307767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.308404:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309508480 00000100:00100000:3.0:1782228981.308414:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309508480 00000100:00100000:3.0:1782228981.308592:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:3.0:1782228981.308613:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+12:9693:x1868802309508480:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:3.0:1782228981.308635:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228981.308666:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496f5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782228981.308785:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782228981.309251:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496f5 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.309268:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43933f00) 00010000:00010000:3.0:1782228981.309271:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782228981.309276:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e638f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496f5 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.309290:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917200, rc 0) 00000100:00100000:3.0:1782228981.309368:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:9693:x1868802309508480:12345-192.168.204.22@tcp:101:rm.0 Request processed in 767us (1611us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1782228981.309375:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:2.0:1782228981.318145:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.318238:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309508608 00000100:00100000:0.0:1782228981.318249:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309508608 00000100:00100000:0.0:1782228981.318308:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:0.0:1782228981.318319:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+13:9693:x1868802309508608:12345-192.168.204.22@tcp:37:rm.0 00000100:00100000:0.0:1782228981.324289:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+13:9693:x1868802309508608:12345-192.168.204.22@tcp:37:rm.0 Request processed in 5960us (6143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228981.324313:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:1.0:1782228981.330137:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228981.330223:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309508864 00000100:00100000:2.0:1782228981.330233:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309508864 00000100:00100000:2.0:1782228981.330332:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:2.0:1782228981.330352:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+13:9693:x1868802309508864:12345-192.168.204.22@tcp:35:rm.0 00000100:00100000:2.0:1782228981.330647:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:9693:x1868802309508864:12345-192.168.204.22@tcp:35:rm.0 Request processed in 296us (518us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782228981.330683:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:3.0:1782228981.333963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228981.334232:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309509120 00000100:00100000:1.0:1782228981.334241:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309509120 00000100:00100000:1.0:1782228981.334299:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:1.0:1782228981.334307:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+14:9693:x1868802309509120:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:1.0:1782228981.334329:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228981.334362:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63907 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99496fc expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228981.334509:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6390e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228981.334523:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6390e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228981.334548:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6390e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782228981.334560:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1782228981.334811:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63907 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496fc expref: 17 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228981.334830:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6390e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496fc expref: 16 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228981.334839:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:1.0:1782228981.334843:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782228981.334846:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421200, rc 0) 00000100:00100000:1.0:1782228981.335052:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+16:9693:x1868802309509120:12345-192.168.204.22@tcp:101:rm.0 Request processed in 744us (1098us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1782228981.335061:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:1.0:1782228981.339823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.339917:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309509248 00000100:00100000:0.0:1782228981.339928:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309509248 00000100:00100000:0.0:1782228981.339984:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 28 00000100:00100000:0.0:1782228981.339994:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+16:9693:x1868802309509248:12345-192.168.204.22@tcp:41:rm.0 00000004:00000024:0.0:1782228981.340055:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1782228981.340132:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+16:9693:x1868802309509248:12345-192.168.204.22@tcp:41:rm.0 Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228981.340140:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 28 00000100:00100000:1.0:1782228981.343630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228981.344005:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309509376 00000100:00100000:3.0:1782228981.344015:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309509376 00000100:00100000:3.0:1782228981.344074:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 29 00000100:00100000:3.0:1782228981.344085:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+16:9693:x1868802309509376:12345-192.168.204.22@tcp:101:rm.0 00010000:00010000:3.0:1782228981.344105:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228981.344125:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e6391c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949703 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344191:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344206:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344217:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344231:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344237:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344243:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344372:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344381:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344402:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782228981.344476:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782228981.344481:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782228981.344500:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344513:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344521:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344528:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344535:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344541:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782228981.344545:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344552:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344565:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:3.0:1782228981.344567:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782228981.344571:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.344588:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63923 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345020:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345028:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345034:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345038:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782228981.345042:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345048:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345057:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff98fe43933000) 00010000:00010000:3.0:1782228981.345060:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782228981.345063:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345069:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917400/0x8e1c8a3488e6392a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345102:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917200/0x8e1c8a3488e6391c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949703 expref: 18 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345130:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949703 expref: 17 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.345137:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe43933c00) 00010000:00010000:3.0:1782228981.345139:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782228981.345141:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916400, rc 0) 00000100:00100000:2.0:1782228981.346194:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+17:9693:x1868802309509376:12345-192.168.204.22@tcp:101:rm.0 Request processed in 2107us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228981.346204:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 29 00000100:00100000:1.0:1782228981.350238:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.350419:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309509632 00000100:00100000:0.0:1782228981.350562:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309509632 00000100:00100000:0.0:1782228981.350630:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:0.0:1782228981.350649:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+17:9693:x1868802309509632:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:0.0:1782228981.350721:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782228981.350749:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949703 expref: 17 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.350769:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e638dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496e7 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.350781:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe43933c00) 00010000:00010000:0.0:1782228981.351168:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e638f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496ee expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351184:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:0.0:1782228981.351201:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782228981.351221:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351234:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351245:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351258:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351266:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351272:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351606:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351616:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.351624:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782228981.353220:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1782228981.353232:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294349800938ns, next at 295349798994ns, rc = 0 00010000:00010000:0.0:1782228981.353292:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353315:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353324:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353332:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353642:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353648:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353712:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782228981.353732:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353739:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353745:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353751:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a0c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.353755:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353761:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353783:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe42cb9d00) 00010000:00010000:0.0:1782228981.353786:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782228981.353790:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353795:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63946 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353822:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353828:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353834:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353839:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a0000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.353841:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353847:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353853:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:0.0:1782228981.353855:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782228981.353863:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.353869:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782228981.353886:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000040b3690 reply state 00000000a503e6ff transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228981.353955:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782228981.354085:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+16:9693:x1868802309509632:12345-192.168.204.22@tcp:36:rm.0 Request processed in 3434us (3854us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782228981.354095:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 30 00010000:00010000:2.0:1782228981.354689:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782228981.354696:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.354703:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782228981.354706:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.354713:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.354722:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98fe42cb9d00) 00010000:00010000:2.0:1782228981.354725:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782228981.354728:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.354733:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e6394d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.354749:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228981.354751:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228981.354753:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782228981.358821:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.358839:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.358857:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.358863:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a1e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782228981.358868:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.358874:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.358891:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xdfab7e5c (ffff98fe42cb9100) 00010000:00010000:2.0:1782228981.358894:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782228981.358899:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228981.358906:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e6393f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xdfab7e5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228981.361163:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.361251:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309509888 00000100:00100000:0.0:1782228981.361261:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309509888 00000100:00100000:0.0:1782228981.361321:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:0.0:1782228981.361331:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:9693:x1868802309509888:12345-192.168.204.22@tcp:35:rm.0 00000100:00100000:0.0:1782228981.361629:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+16:9693:x1868802309509888:12345-192.168.204.22@tcp:35:rm.0 Request processed in 298us (589us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782228981.361637:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:1.0:1782228981.364164:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228981.364328:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309510144 00000100:00100000:0.0:1782228981.364346:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309510144 00000100:00100000:0.0:1782228981.364471:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 31 00000100:00100000:0.0:1782228981.364483:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+16:9693:x1868802309510144:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:0.0:1782228981.364538:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782228981.364563:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6390e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496fc expref: 16 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364582:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e638ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496d9 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364593:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:0.0:1782228981.364623:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e6386d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496cb expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364631:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43933f00) 00010000:00010000:0.0:1782228981.364636:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782228981.364675:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364687:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364696:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364708:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364716:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.364722:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365028:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365037:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365044:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782228981.365695:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1782228981.365718:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365726:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365733:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365739:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a0000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.365743:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365752:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365762:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98fe42cb9b00) 00010000:00010000:0.0:1782228981.365766:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782228981.365769:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365776:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0000/0x8e1c8a3488e63962 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365799:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365806:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365811:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365816:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782228981.365824:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365831:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365839:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9200) 00010000:00010000:0.0:1782228981.365842:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782228981.365845:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228981.365851:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e63954 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782228981.365864:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c112537a reply state 0000000055edba07 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228981.365872:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782228981.365942:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:9693:x1868802309510144:12345-192.168.204.22@tcp:36:rm.0 Request processed in 1460us (1784us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782228981.365949:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 31 00010000:00010000:3.0:1782228981.368042:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.368057:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.368064:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.368069:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782228981.368073:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.368080:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.368095:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98fe42cb9800) 00010000:00010000:3.0:1782228981.368098:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782228981.368101:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228981.368107:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e6395b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228982.139736:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228983.165497:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228984.187651:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782228984.443585:0:7532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297440152186ns, next at 298440149494ns, rc = 0 00000100:00100000:0.0:1782228984.443687:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329464576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228984.443780:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.444092:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329464704:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444130:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.444172:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329465216:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.444221:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782228984.444226:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329465088:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444250:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.444277:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329464832:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.444318:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329465344:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.444350:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782228984.444356:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329464960:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.444407:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464704 00000100:00100000:3.0:1782228984.444415:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464704 00000100:00100000:3.0:1782228984.444481:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782228984.444492:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329464704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444541:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329464704:12345-0@lo:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228984.444548:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782228984.444579:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329465216 00000100:00100000:3.0:1782228984.444583:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329465216 00000100:00100000:3.0:1782228984.444625:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464832 00000100:00100000:3.0:1782228984.444629:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464832 00000100:00100000:3.0:1782228984.444658:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464960 00000100:00100000:3.0:1782228984.444661:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464960 00000100:00100000:3.0:1782228984.444674:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782228984.444680:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329465216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444723:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329465216:12345-0@lo:400:kworker.0 Request processed in 42us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228984.444729:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782228984.444754:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782228984.444760:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329464832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.444792:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329464832:12345-0@lo:400:kworker.0 Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228984.444912:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782228984.444920:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329464960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228984.444950:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329464960:12345-0@lo:400:kworker.0 Request processed in 32us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228984.444967:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782228984.447025:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782228984.447071:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329465088 00000100:00100000:3.0:1782228984.447079:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329465088 00000100:00100000:3.0:1782228984.447130:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329465344 00000100:00100000:3.0:1782228984.447134:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329465344 00000100:00100000:3.0:1782228984.447164:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782228984.447173:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329465088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.447242:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329465088:12345-0@lo:400:kworker.0 Request processed in 71us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228984.447249:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782228984.447260:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782228984.447266:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329465344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.447295:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329465344:12345-0@lo:400:kworker.0 Request processed in 29us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228984.447301:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1782228984.447329:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782228984.447343:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782228984.447345:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228984.447383:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329464960:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.447397:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329464832:0@lo:400:kworker.0 00010000:00080000:3.0:1782228984.447410:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779d1500 x1868802329465344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782229000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228984.447420:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329465344:0@lo:400:kworker.0 00010000:00080000:3.0:1782228984.447494:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779d3480 x1868802329465088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782229000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228984.447504:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329465088:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.447515:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329464704:0@lo:400:kworker.0 00000100:00100000:3.0:1782228984.447525:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329465216:0@lo:400:kworker.0 00000100:00100000:1.0:1782228984.451229:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329464576 00000100:00100000:1.0:1782228984.451247:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329464576 00000100:00100000:1.0:1782228984.451302:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782228984.451312:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329464576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228984.451354:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228984.451462:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329464576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (7681us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228984.451470:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1782228984.451520:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73f64000 x1868802329464576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228984.451540:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329464576:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782228984.920832:0:11480:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1782228984.955603:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329465472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782228984.955682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228984.956614:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329465472 00000100:00100000:3.0:1782228984.956624:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329465472 00000100:00100000:3.0:1782228984.957724:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782228984.957737:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329465472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782228984.957773:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782228984.957843:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329465472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228984.957850:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1782228984.961179:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73f64000 x1868802329465472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228984.961222:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329465472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228985.211867:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782228985.419017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228985.419104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228985.419132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228985.419167:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228985.419282:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309510400 00000100:00100000:1.0:1782228985.419283:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309510656 00000100:00100000:3.0:1782228985.419291:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309510400 00000100:00100000:1.0:1782228985.419291:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309510656 00000100:00100000:2.0:1782228985.419357:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309510528 00000100:00100000:2.0:1782228985.419361:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309510528 00000100:00100000:3.0:1782228985.419455:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 105 00000100:00100000:2.0:1782228985.419540:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:2.0:1782228985.419549:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2371:x1868802309510528:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228985.419677:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 106 00000100:00100000:1.0:1782228985.419684:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309510656:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228985.419769:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309510656:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 85us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228985.419776:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 106 00000100:00100000:0.0:1782228985.421742:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309510272 00000100:00100000:0.0:1782228985.421755:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309510272 00000100:00100000:0.0:1782228985.421810:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 250 00000100:00100000:0.0:1782228985.421819:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309510272:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228985.422038:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309510272:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 62us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228985.422045:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 250 00000100:00100000:2.0:1782228985.423223:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2371:x1868802309510528:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 3671us (4049us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228985.423250:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00080000:2.0:1782228985.423339:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782228985.423345:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228985.425834:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:2370:x1868802309510400:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228985.425926:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:2370:x1868802309510400:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 6462us (6821us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228985.425937:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 105 00000020:00000080:0.0:1782228985.865123:0:11528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb1fd1c10 20000000:00000080:0.0:1782228985.865141:0:11528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fe741e0c00 uarg=0000000000000000 20000000:01000000:0.0:1782228985.865179:0:11528:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1782228985.865185:0:11528:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1782228985.865190:0:11528:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1782228985.871848:0:11529:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1782228985.872207:0:11528:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1782228985.878748:0:11528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1782228985.878833:0:11528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1782228985.878889:0:11528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1782228985.878904:0:11528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782228985.878926:0:11528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.878949:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.878959:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.878968:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.878983:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.878991:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.879005:0:11528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.879043:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.879057:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 18 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228985.879071:0:11528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465600:0@lo:104: 00000100:00100000:1.0:1782228985.879135:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228985.879188:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.879195:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 18 pid: 5792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228985.879203:0:11528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465728:0@lo:104: 00000100:00100000:1.0:1782228985.879222:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228985.879321:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.879329:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 18 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228985.879342:0:11528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465856:0@lo:104: 00000100:00100000:1.0:1782228985.879367:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782228985.879951:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.879963:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 12 pid: 5790 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228985.879973:0:11528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465984:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782228985.880031:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.880040:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 12 pid: 5792 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228985.880049:0:11528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329466112:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782228985.880071:0:11528:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228985.880125:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782228985.880138:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329465600 00000100:00100000:3.0:1782228985.880145:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329465600 00000100:00100000:3.0:1782228985.880180:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329465728 00000100:00100000:3.0:1782228985.880183:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329465728 00000100:00100000:3.0:1782228985.880194:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329465856 00000100:00100000:3.0:1782228985.880196:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329465856 00000100:00100000:3.0:1782228985.880210:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782228985.880218:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:11528:x1868802329465600:12345-0@lo:104: 00010000:00010000:3.0:1782228985.880230:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.880288:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782228985.880294:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+5:11528:x1868802329465600:12345-0@lo:104: Request processed in 77us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228985.880301:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782228985.880318:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782228985.880324:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:11528:x1868802329465728:12345-0@lo:104: 00010000:00010000:3.0:1782228985.880337:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.880368:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782228985.880373:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+4:11528:x1868802329465728:12345-0@lo:104: Request processed in 50us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228985.880380:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782228985.880391:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782228985.880397:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11528:x1868802329465856:12345-0@lo:104: 00010000:00010000:3.0:1782228985.880404:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.880448:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782228985.880453:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+3:11528:x1868802329465856:12345-0@lo:104: Request processed in 56us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228985.880459:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782228985.880625:0:11528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465600:0@lo:104: 00000100:00100000:1.0:1782228985.880634:0:11528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465728:0@lo:104: 00000100:00100000:1.0:1782228985.880640:0:11528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465856:0@lo:104: 00010000:00010000:0.0:1782228985.880905:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782228985.880970:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.880978:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030400 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228985.880982:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.880990:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228985.880998:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228985.881010:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782228985.881044:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881049:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228985.881068:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881074:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e63835 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6383c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881086:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782228985.881089:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881094:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228985.881096:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881170:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228985.881176:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228985.881182:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782228985.881196:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881202:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228985.881214:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881220:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe74421000/0x8e1c8a3488e63827 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6382e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881229:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228985.881233:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881238:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcde00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782228985.881241:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881247:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782228985.881253:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782228985.881258:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782228985.881271:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881276:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782228985.881290:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881297:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe81dcde00/0x8e1c8a3488e63819 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e63820 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881309:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228985.881315:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228985.881317:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228985.881324:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228985.881329:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228985.881337:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329466368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782228985.881338:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329466496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782228985.881369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228985.881394:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329466496 00000100:00100000:0.0:1782228985.881398:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329466496 00000100:00100000:3.0:1782228985.881415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782228985.881417:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 19 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228985.881448:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782228985.881452:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329466368 00000100:00100000:3.0:1782228985.881454:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329466240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782228985.881455:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329466368 00010000:00010000:0.0:1782228985.881467:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 20 pid: 5792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228985.881480:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782228985.881485:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+20:3308:x1868802329466496:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782228985.881489:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782228985.881495:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228985.881500:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 20 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881509:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 20 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228985.881510:0:5781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782228985.881517:0:5781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1782228985.881522:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe74421400/0x8e1c8a3488e63820 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63819 expref: 20 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228985.881533:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1782228985.881533:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228985.881539:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329466240 00000100:00100000:3.0:1782228985.881542:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329466240 00010000:00010000:3.0:1782228985.881554:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 20 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228985.881561:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+20:3308:x1868802329466496:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228985.881585:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782228985.881593:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782228985.881599:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+20:3311:x1868802329466368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782228985.881606:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228985.881610:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 20 pid: 5792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.881618:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 20 pid: 5792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.881628:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e6382e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63827 expref: 20 pid: 5792 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.881636:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228985.881648:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782228985.881660:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3311:x1868802329466368:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228985.881663:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782228985.881666:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782228985.881669:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782228985.881675:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3311:x1868802329466240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782228985.881682:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228985.881686:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 17 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881697:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 17 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881706:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e6383c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e63835 expref: 17 pid: 5791 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.881713:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228985.881733:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3311:x1868802329466240:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228985.881739:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782228985.882002:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329466496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782228985.882006:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1782228985.882025:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329466240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782228985.882033:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329466368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782228985.885289:0:11528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329465984:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782228985.885305:0:11528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f64e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1868802329466112:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782228985.885340:0:11528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782228985.886287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228985.887642:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309510784 00000100:00100000:3.0:1782228985.887654:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309510784 00000100:00100000:0.0:1782228985.887665:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228985.887689:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309510912 00010000:00010000:3.0:1782228985.887691:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 13 pid: 5790 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228985.887692:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309510912 00010000:00010000:0.0:1782228985.887722:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 14 pid: 5792 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228985.887732:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:3.0:1782228985.887890:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+14:2371:x1868802309510784:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782228985.887915:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782228985.887923:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 14 pid: 5790 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.887936:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 14 pid: 5790 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.887953:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e63812 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496bd expref: 14 pid: 5790 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228985.887975:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782228985.888032:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2371:x1868802309510784:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 143us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228985.888724:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:0.0:1782228985.888735:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309510912:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782228985.888745:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782228985.888750:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 13 pid: 5792 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888779:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 13 pid: 5792 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888792:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6380b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99496b6 expref: 13 pid: 5792 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888804:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888812:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888828:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888836:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888844:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888852:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888858:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782228985.888862:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888871:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888895:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228985.888906:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782228985.888939:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:2372:x1868802309510912:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 207us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228985.888947:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 34 00010000:00010000:1.0:1782228985.889117:0:11528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.889126:0:11528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228985.889132:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe74420a00/0x8e1c8a3488e63969 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228985.889826:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 33 00010000:00010000:0.0:1782228986.235833:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782228986.523570:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1782228986.523594:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1782228986.523622:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1782228986.523829:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329466624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782228986.523898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228986.523993:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329466624 00000100:00100000:1.0:1782228986.524000:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329466624 00000100:00100000:1.0:1782228986.524056:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782228986.524065:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329466624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782228986.524107:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1782228986.524142:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a3aa7f5, atime: 0x6a3aa7f5, ctime: 0x6a3aa7f5, blocks: 0x1 00010000:00010000:1.0:1782228986.524150:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228986.524165:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=299s v=(0 0) 00010000:00010000:1.0:1782228986.524169:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782228986.524174:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228986.524189:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228986.524210:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228986.524218:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228986.524232:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782228986.525045:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329466624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 978us (1143us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782228986.525054:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1782228986.525080:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1782228986.525219:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe7be3b100/2, rc 0, transno 4294967300 00000100:00100000:0.0:1782228986.525225:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329466624:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782228986.525246:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782228986.525251:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228986.525262:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782228986.525266:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228986.525276:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228986.525297:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228986.525315:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e63970 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228986.525335:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228986.525337:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228986.525339:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228987.259767:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782228987.451569:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782228987.451578:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7fe6d000 from 7 10000000:01000000:3.0:1782228987.451583:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782228987.451632:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.451646:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.451657:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228987.451695:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329466752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782228987.451767:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228987.451851:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1782228987.452261:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329466752 00000100:00100000:2.0:1782228987.452268:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329466752 00000100:00100000:2.0:1782228987.452322:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1782228987.452332:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:5794:x1868802329466752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228987.452347:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782228987.452362:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcd200/0x8e1c8a3488e6397e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e63977 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.452386:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcd200/0x8e1c8a3488e6397e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e63977 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.452394:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcd200/0x8e1c8a3488e6397e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e63977 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.452401:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd200, rc 0) 00000100:00100000:2.0:1782228987.452460:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329466752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228987.452465:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1782228987.454943:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329466752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228987.454969:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.454988:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228987.455068:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329466880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228987.455132:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228987.455248:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0480 going to sleep for 11 seconds 00000100:00100000:0.0:1782228987.455390:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329466880 00000100:00100000:0.0:1782228987.455397:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329466880 00000100:00100000:0.0:1782228987.455478:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1782228987.455488:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329466880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782228987.455883:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe508b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329466880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228987.455891:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1782228987.455955:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329466880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228987.455985:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782228987.456026:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228987.456050:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1782228987.456077:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467008 00000100:00100000:2.0:1782228987.456082:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467008 00000100:00100000:2.0:1782228987.456117:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1782228987.456125:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329467008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.456292:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329467008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228987.456305:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1782228987.456363:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228987.457033:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11545:1868802329467136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228987.457073:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228987.457148:0:11545:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bba1000 going to sleep for 11 seconds 00000100:00100000:3.0:1782228987.457227:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467136 00000100:00100000:3.0:1782228987.457232:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467136 00000100:00100000:3.0:1782228987.457294:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1782228987.457303:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:11545:x1868802329467136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228987.457483:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:11545:x1868802329467136:12345-0@lo:502:llog_process_th.0 Request processed in 182us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.457491:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1782228987.457574:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11545:1868802329467136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228987.457598:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228987.457608:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228987.457610:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782228987.457616:0:11545:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98fe7fe6d000 00000020:00000080:2.0:1782228987.457619:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782228987.457695:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11545:1868802329467264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228987.457728:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228987.461463:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467264 00000100:00100000:0.0:1782228987.461477:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467264 00000100:00100000:0.0:1782228987.461524:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1782228987.461532:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:11545:x1868802329467264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228987.461796:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5096e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:11545:x1868802329467264:12345-0@lo:502:llog_process_th.0 Request processed in 263us (4065us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228987.461809:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1782228987.462519:0:11545:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782228987.462551:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11545:1868802329467264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782228987.462858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228987.462962:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511040 00000100:00100000:3.0:1782228987.462969:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511040 00000100:00100000:3.0:1782228987.463013:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 256 00000100:00100000:3.0:1782228987.463031:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:5586:x1868802309511040:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228987.463045:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228987.463063:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50917400/0x8e1c8a3488e63985 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994970a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.463090:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50917400/0x8e1c8a3488e63985 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994970a expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.463102:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50917400/0x8e1c8a3488e63985 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994970a expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.463112:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917400, rc 0) 00000100:00100000:3.0:1782228987.463161:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309511040:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 132us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.463169:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 256 00000020:01000000:2.0:1782228987.463897:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228987.463908:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228987.463911:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782228987.463918:0:11545:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782228987.464062:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782228987.464081:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782228987.464090:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.464101:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782228987.464112:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782228987.464114:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe7b8d6000 from 7 10000000:01000000:2.0:1782228987.464423:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782228987.464478:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.464499:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.464510:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228987.464534:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.464593:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228987.464643:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467392 00000100:00100000:2.0:1782228987.464643:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782228987.464651:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467392 00000100:00100000:3.0:1782228987.464707:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1782228987.464716:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:5794:x1868802329467392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228987.464727:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782228987.464746:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e63993 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6398c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.464776:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e63993 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6398c expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.464787:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e63993 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6398c expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.464806:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916a00, rc 0) 00000100:00100000:3.0:1782228987.464843:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329467392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.464850:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1782228987.465326:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782228987.465343:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.465353:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228987.465416:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.465468:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228987.465491:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228987.466112:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467520 00000100:00100000:1.0:1782228987.466120:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467520 00000100:00100000:1.0:1782228987.466164:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1782228987.466173:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329467520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228987.466632:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329467520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228987.466651:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1782228987.466871:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.466991:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.467037:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228987.467069:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782228987.467409:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467648 00000100:00100000:1.0:1782228987.467414:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467648 00000100:00100000:1.0:1782228987.467498:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1782228987.467509:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329467648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228987.467978:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329467648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 471us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228987.467994:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1782228987.468477:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329467648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782228987.468907:0:11548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11548:1868802329467776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228987.468951:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228987.468984:0:11548:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782228987.469476:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467776 00000100:00100000:2.0:1782228987.469487:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467776 00000100:00100000:2.0:1782228987.469523:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1782228987.469530:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:11548:x1868802329467776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228987.469732:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:11548:x1868802329467776:12345-0@lo:502:llog_process_th.0 Request processed in 202us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228987.469747:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1782228987.469960:0:11548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11548:1868802329467776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782228987.469986:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782228987.470001:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228987.470004:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782228987.470013:0:11548:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98fe7b8d6000 00000020:00000080:1.0:1782228987.470015:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782228987.470091:0:11548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11548:1868802329467904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228987.470129:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228987.470159:0:11548:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782228987.470502:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329467904 00000100:00100000:0.0:1782228987.470512:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329467904 00000100:00100000:1.0:1782228987.470606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228987.470628:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511168 00000100:00100000:1.0:1782228987.470632:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511168 00000100:00100000:1.0:1782228987.470654:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1782228987.470662:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:11548:x1868802329467904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782228987.471053:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:11548:x1868802329467904:12345-0@lo:502:llog_process_th.0 Request processed in 390us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228987.471060:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1782228987.471090:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 262 00000100:00100000:1.0:1782228987.471099:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309511168:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782228987.471305:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309511168:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 207us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228987.471322:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 262 00000100:00100000:1.0:1782228987.471358:0:11548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f66300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11548:1868802329467904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782228987.471382:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782228987.471388:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782228987.471389:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782228987.471395:0:11548:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782228987.472871:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782228987.472964:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782228987.472977:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.472990:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782228987.473003:0:5794:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782228987.473006:0:5794:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe50300000 from 7 10000000:01000000:2.0:1782228987.473009:0:5794:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782228987.473088:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.473097:0:5794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782228987.473107:0:5794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228987.473132:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329468032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.473192:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228987.473372:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782228987.473425:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468032 00000100:00100000:1.0:1782228987.473558:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468032 00000040:00080000:3.0:1782228987.474333:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782228987.474419:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782228987.474518:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:5794:x1868802329468032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782228987.474534:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782228987.474571:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe74421600/0x8e1c8a3488e639a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6399a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228987.474598:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe74421600/0x8e1c8a3488e639a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6399a expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782228987.477018:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228987.477207:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511296 00000100:00100000:2.0:1782228987.477227:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511296 00000100:00100000:2.0:1782228987.477420:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 264 00000100:00100000:2.0:1782228987.477451:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309511296:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 00010000:00010000:1.0:1782228987.477596:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe74421600/0x8e1c8a3488e639a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6399a expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782228987.477675:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421600, rc 0) 00000100:00100000:1.0:1782228987.477739:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329468032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3309us (4546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228987.477749:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1782228987.477776:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329468032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782228987.477800:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.477810:0:5794:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782228987.477852:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309511296:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 Request processed in 422us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228987.477862:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 264 00000100:00100000:3.0:1782228987.477886:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329468160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228987.477920:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228987.477953:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1782228987.478025:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468160 00000100:00100000:2.0:1782228987.478030:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468160 00000100:00100000:2.0:1782228987.478071:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782228987.478077:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329468160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.478827:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329468160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 749us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228987.478834:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782228987.478875:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329468160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.478903:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329468288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.478948:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228987.478970:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782228987.479328:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468288 00000100:00100000:0.0:1782228987.479335:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468288 00000100:00100000:0.0:1782228987.479409:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782228987.479418:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329468288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228987.479572:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe58170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:5794:x1868802329468288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228987.479580:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782228987.479657:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9dd69a8-6985-42fa-86d8-1fd8a4966144:5794:1868802329468288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782228987.480110:0:11550:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11550:1868802329468416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228987.480153:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228987.480187:0:11550:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782228987.480487:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468416 00000100:00100000:3.0:1782228987.480492:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468416 00000100:00100000:3.0:1782228987.480522:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1782228987.480529:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:11550:x1868802329468416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228987.480689:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:11550:x1868802329468416:12345-0@lo:502:llog_process_th.0 Request processed in 160us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.480696:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782228987.481115:0:11550:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11550:1868802329468416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228987.481138:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782228987.481146:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228987.481151:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782228987.481156:0:11550:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98fe50300000 00000020:00000080:2.0:1782228987.481158:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782228987.481221:0:11550:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11550:1868802329468544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782228987.481250:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228987.481265:0:11550:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782228987.481643:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468544 00000100:00100000:3.0:1782228987.481649:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468544 00000100:00100000:3.0:1782228987.481691:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1782228987.481699:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:11550:x1868802329468544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782228987.481973:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:11550:x1868802329468544:12345-0@lo:502:llog_process_th.0 Request processed in 274us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.481978:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1782228987.482027:0:11550:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9dd69a8-6985-42fa-86d8-1fd8a4966144:11550:1868802329468544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782228987.482041:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782228987.482044:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782228987.482046:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782228987.482048:0:11550:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782228987.482199:0:5794:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782228987.482214:0:5794:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782228987.482222:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782228987.482230:0:5794:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782228987.488669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782228987.488717:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511424 00000100:00100000:2.0:1782228987.488727:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511424 00000100:00100000:2.0:1782228987.488789:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 269 00000100:00100000:2.0:1782228987.488800:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:9964:x1868802309511424:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782228987.489107:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:9964:x1868802309511424:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 309us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228987.489116:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 269 00000100:00100000:2.0:1782228987.495525:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228987.495569:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511552 00000100:00100000:3.0:1782228987.495579:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511552 00000100:00100000:3.0:1782228987.495627:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 270 00000100:00100000:3.0:1782228987.495637:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:9964:x1868802309511552:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782228987.495911:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:9964:x1868802309511552:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 275us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.495920:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 270 00000100:00100000:1.0:1782228987.524186:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228987.524246:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511680 00000100:00100000:0.0:1782228987.524256:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511680 00000100:00100000:0.0:1782228987.524367:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 271 00000100:00100000:0.0:1782228987.524386:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+12:5586:x1868802309511680:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782228987.524407:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782228987.524447:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe414a0000/0x8e1c8a3488e639a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949711 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228987.524476:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe414a0000/0x8e1c8a3488e639a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949711 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228987.524486:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe414a0000/0x8e1c8a3488e639a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949711 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782228987.524495:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe414a0000, rc 0) 00000100:00100000:0.0:1782228987.524571:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309511680:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 187us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228987.524578:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 271 00000100:00100000:0.0:1782228987.530693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228987.531581:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511808 00000100:00100000:3.0:1782228987.531593:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511808 00000100:00100000:3.0:1782228987.531652:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 272 00000100:00100000:3.0:1782228987.531663:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309511808:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782228987.532496:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309511808:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 833us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.532514:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 272 00000100:00100000:2.0:1782228987.534642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228987.534835:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309511936 00000100:00100000:0.0:1782228987.534845:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309511936 00000100:00100000:0.0:1782228987.534902:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 273 00000100:00100000:0.0:1782228987.534912:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309511936:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782228987.535119:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:5586:x1868802309511936:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 Request processed in 207us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228987.535127:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 273 00000100:00100000:1.0:1782228987.545044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782228987.545125:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512064 00000100:00100000:3.0:1782228987.545136:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512064 00000100:00100000:3.0:1782228987.545194:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 274 00000100:00100000:3.0:1782228987.545203:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:9967:x1868802309512064:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782228987.545467:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:9967:x1868802309512064:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 262us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228987.545476:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 274 00000100:00100000:2.0:1782228987.554851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228987.555191:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512192 00000100:00100000:0.0:1782228987.555202:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512192 00000100:00100000:0.0:1782228987.555252:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 275 00000100:00100000:0.0:1782228987.555261:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:9967:x1868802309512192:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782228987.555850:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:9967:x1868802309512192:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 588us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228987.555859:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 275 00010000:00010000:0.0:1782228988.283918:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782228988.476747:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782228989.308687:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782228989.563821:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329468800:0@lo:400:kworker.0 00000100:00100000:3.0:1782228989.563919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228989.563986:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329469056:0@lo:400:kworker.0 00000100:00100000:3.0:1782228989.563994:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329469312:0@lo:400:kworker.0 00000100:00100000:0.0:1782228989.564031:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228989.564062:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782228989.564079:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329468928:0@lo:400:kworker.0 00000100:00100000:0.0:1782228989.564106:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228989.564279:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468800 00000100:00100000:0.0:1782228989.564288:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468800 00000100:00100000:0.0:1782228989.564334:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468928 00000100:00100000:0.0:1782228989.564337:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468928 00000100:00100000:0.0:1782228989.564367:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782228989.564378:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329468800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228989.564467:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329468800:12345-0@lo:400:kworker.0 Request processed in 91us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228989.564474:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782228989.564656:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782228989.564663:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329468928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228989.564920:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469056 00000100:00100000:2.0:1782228989.564925:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469056 00000100:00100000:2.0:1782228989.564958:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782228989.564964:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329469056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228989.565090:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329468672:0@lo:400:kworker.0 00000100:00100000:2.0:1782228989.574518:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329469056:12345-0@lo:400:kworker.0 Request processed in 9532us (10466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228989.574549:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1782228989.574718:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782228989.574724:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228989.574741:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329469440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782228989.574987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228989.575384:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329468928:0@lo:400:kworker.0 00010000:00080000:2.0:1782228989.575399:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c88e00 x1868802329469056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782229005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228989.575408:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329469056:0@lo:400:kworker.0 00000100:00100000:0.0:1782228989.582180:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329468928:12345-0@lo:400:kworker.0 Request processed in 17500us (18056us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228989.582250:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469440 00000100:00100000:1.0:1782228989.582260:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469440 00000100:00100000:1.0:1782228989.582348:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782228989.582358:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329469440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228989.582406:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228989.582520:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329469440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228989.582528:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782228989.582698:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228989.582740:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469312 00000100:00100000:3.0:1782228989.582744:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469312 00000100:00100000:3.0:1782228989.582774:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782228989.582781:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329469312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228989.582814:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329469312:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228989.582820:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782228989.582876:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329469312:0@lo:400:kworker.0 00000100:00100000:3.0:1782228989.582911:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329468800:0@lo:400:kworker.0 00000100:00100000:1.0:1782228989.582994:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329469440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228989.583040:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228989.583212:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329469184:0@lo:400:kworker.0 00000100:00100000:1.0:1782228989.583247:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228989.583272:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469184 00000100:00100000:1.0:1782228989.583276:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469184 00000100:00100000:1.0:1782228989.583309:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782228989.583316:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329469184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228989.583346:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329469184:12345-0@lo:400:kworker.0 Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228989.583352:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782228989.583381:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329469184:0@lo:400:kworker.0 00000100:00100000:3.0:1782228989.583456:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329468672 00000100:00100000:3.0:1782228989.583460:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329468672 00000100:00100000:3.0:1782228989.583511:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1782228989.583518:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329468672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228989.583554:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329468672:12345-0@lo:400:kworker.0 Request processed in 36us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228989.583611:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1782228989.583697:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329468672:0@lo:400:kworker.0 00000100:00100000:0.0:1782228989.584604:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1782228989.585628:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782228989.585637:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782228990.077794:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329469568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782228990.077881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228990.078113:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469568 00000100:00100000:2.0:1782228990.078121:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469568 00000100:00100000:2.0:1782228990.078174:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782228990.078183:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329469568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782228990.078219:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782228990.078267:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329469568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228990.078273:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1782228990.078714:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be3bb80 x1868802329469568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782228990.078735:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329469568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782228990.331791:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228990.526763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228990.526801:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228990.526834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228990.526863:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782228990.526900:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512576 00000100:00100000:0.0:1782228990.526908:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512576 00000100:00100000:0.0:1782228990.526962:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:0.0:1782228990.526972:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309512576:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228990.527036:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309512576:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 66us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228990.527042:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:1.0:1782228990.527138:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512448 00000100:00100000:1.0:1782228990.527142:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512448 00000100:00100000:1.0:1782228990.527179:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512704 00000100:00100000:1.0:1782228990.527194:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512704 00000100:00100000:1.0:1782228990.527229:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110 00000100:00100000:1.0:1782228990.527236:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309512448:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228990.527266:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309512448:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228990.527273:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110 00000100:00100000:1.0:1782228990.527297:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 111 00000100:00100000:1.0:1782228990.527304:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309512704:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228990.527328:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309512704:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 25us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228990.527334:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 111 00000100:00100000:3.0:1782228990.527661:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512320 00000100:00100000:3.0:1782228990.527665:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512320 00000100:00100000:3.0:1782228990.527713:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 277 00000100:00100000:3.0:1782228990.527720:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309512320:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228990.527747:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309512320:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 28us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228990.527753:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 277 00000100:00080000:2.0:1782228990.527962:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782228990.527968:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782228991.356857:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782228991.637327:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1782228992.379844:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228993.403677:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228994.427784:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228994.683705:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329469696:0@lo:400:kworker.0 00000100:00100000:1.0:1782228994.683802:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228994.683865:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782228994.683872:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329469824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228994.683903:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228994.683938:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469696 00000100:00100000:1.0:1782228994.683945:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469696 00000100:00100000:1.0:1782228994.683989:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1782228994.683998:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329469696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228994.684049:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329469696:12345-0@lo:400:kworker.0 Request processed in 51us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228994.684057:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1782228994.684105:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469824 00000100:00100000:1.0:1782228994.684109:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469824 00000100:00100000:1.0:1782228994.684148:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782228994.684154:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329469824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228994.684186:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228994.684219:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329469824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228994.684225:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1782228994.684245:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782228994.684273:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1782228994.684278:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe7be3b100, transno 4294967300 00000100:00100000:1.0:1782228994.684297:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329469824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782228994.684308:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329469696:0@lo:400:kworker.0 00000100:00100000:1.0:1782228994.686499:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329469952:0@lo:400:kworker.0 00000100:00100000:3.0:1782228994.686529:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329470336:0@lo:400:kworker.0 00000100:00100000:0.0:1782228994.686560:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329470080:0@lo:400:kworker.0 00000100:00100000:2.0:1782228994.686621:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329470208:0@lo:400:kworker.0 00000100:00100000:3.0:1782228994.689814:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782228994.689897:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470336 00000100:00100000:3.0:1782228994.689905:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470336 00000100:00100000:3.0:1782228994.689958:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782228994.689967:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329470336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228994.690035:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329470336:12345-0@lo:400:kworker.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228994.690042:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1782228994.690066:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782228994.690096:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329470336:0@lo:400:kworker.0 00000100:00100000:1.0:1782228994.690369:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228994.690403:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228994.690427:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329469952 00000100:00100000:1.0:1782228994.690453:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329469952 00000100:00100000:2.0:1782228994.690474:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470208 00000100:00100000:2.0:1782228994.690480:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470208 00000100:00100000:1.0:1782228994.690486:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782228994.690496:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329469952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228994.690520:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782228994.690538:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329469952:12345-0@lo:400:kworker.0 Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228994.690544:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329470208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228994.690552:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782228994.690583:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329469952:0@lo:400:kworker.0 00000100:00080000:3.0:1782228994.691591:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782228994.691982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782228994.692084:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe779d1500 x1868802329470208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782229010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782228994.692097:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470080 00000100:00100000:1.0:1782228994.692105:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470080 00000100:00100000:3.0:1782228994.692121:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329470208:0@lo:400:kworker.0 00000100:00100000:1.0:1782228994.692198:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782228994.692214:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329470080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782228994.692329:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329470080:12345-0@lo:400:kworker.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228994.692336:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782228994.692380:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329470080:0@lo:400:kworker.0 00000100:00080000:0.0:1782228994.692426:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228994.693414:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329470208:12345-0@lo:400:kworker.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228994.693425:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782228995.196334:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329470464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782228995.196422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782228995.199964:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470464 00000100:00100000:1.0:1782228995.199979:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470464 00000100:00100000:1.0:1782228995.200058:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782228995.200070:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329470464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782228995.200114:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228995.200258:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329470464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228995.200266:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1782228995.200546:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe7be3b100 x1868802329470464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782228995.200568:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329470464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782228995.451810:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782228995.647182:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228995.647222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228995.647261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228995.647340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782228995.647369:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512960 00000100:00100000:1.0:1782228995.647392:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512960 00000100:00100000:1.0:1782228995.647494:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513216 00000100:00100000:1.0:1782228995.647498:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513216 00000100:00100000:1.0:1782228995.647521:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 115 00000100:00100000:1.0:1782228995.647530:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309512960:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228995.647609:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309512960:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228995.647616:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 115 00000100:00100000:1.0:1782228995.647647:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 116 00000100:00100000:1.0:1782228995.647653:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309513216:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782228995.647693:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309513216:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228995.647699:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 116 00000100:00080000:1.0:1782228995.647715:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228995.648019:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513088 00000100:00100000:0.0:1782228995.648024:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513088 00000100:00100000:0.0:1782228995.648064:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:0.0:1782228995.648071:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309513088:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782228995.648103:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309513088:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 33us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228995.648109:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00080000:1.0:1782228995.648172:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782228995.648615:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309512832 00000100:00100000:3.0:1782228995.648621:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309512832 00000100:00100000:3.0:1782228995.650290:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 279 00000100:00100000:3.0:1782228995.650306:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309512832:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782228995.650503:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309512832:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 202us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228995.650511:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 279 00010000:00010000:1.0:1782228996.476118:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782228997.500231:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782228998.524027:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782228998.717705:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782228999.551171:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782228999.803768:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329470592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782228999.803842:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228999.804229:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329470976:0@lo:400:kworker.0 00000100:00100000:2.0:1782228999.804263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228999.804286:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782228999.804291:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329471104:0@lo:400:kworker.0 00000100:00100000:2.0:1782228999.804339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782228999.804386:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470976 00000100:00100000:2.0:1782228999.804392:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470976 00000100:00100000:2.0:1782228999.804475:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782228999.804486:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329470976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782228999.804551:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329470976:12345-0@lo:400:kworker.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782228999.804558:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1782228999.804591:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782228999.804628:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329470976:0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.804886:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329470848:0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.804914:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228999.804943:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782228999.804951:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329470720:0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.804977:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228999.805001:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329471232:0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.805021:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782228999.805046:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470720 00000100:00100000:0.0:1782228999.805049:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470720 00000100:00100000:0.0:1782228999.805089:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1782228999.805095:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329470720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.805130:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329470720:12345-0@lo:400:kworker.0 Request processed in 36us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228999.805136:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1782228999.805163:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470848 00000100:00100000:0.0:1782228999.805167:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470848 00000100:00100000:0.0:1782228999.805187:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329471232 00000100:00100000:0.0:1782228999.805190:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329471232 00000100:00100000:0.0:1782228999.805212:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782228999.805219:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329470848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.805248:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329470848:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228999.805254:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782228999.805266:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782228999.805272:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329471232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.805313:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329471232:12345-0@lo:400:kworker.0 Request processed in 41us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782228999.805319:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1782228999.805338:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782228999.805354:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329470720:0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.805363:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329471232:0@lo:400:kworker.0 00000100:00100000:0.0:1782228999.805370:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329470848:0@lo:400:kworker.0 00000100:00100000:3.0:1782228999.805907:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329471104 00000100:00100000:3.0:1782228999.805913:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329471104 00000100:00100000:3.0:1782228999.805956:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782228999.805964:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329471104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782228999.806011:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329471104:12345-0@lo:400:kworker.0 Request processed in 48us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1782228999.806018:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1782228999.806049:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c8b480 x1868802329471104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782229015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782228999.806060:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329471104:0@lo:400:kworker.0 00000100:00100000:1.0:1782228999.806572:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329470592 00000100:00100000:1.0:1782228999.806578:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329470592 00000100:00080000:0.0:1782228999.806702:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782228999.806704:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1782228999.806707:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782228999.806715:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329470592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782228999.806748:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782228999.806802:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329470592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1782228999.806809:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782228999.806885:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329470592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229000.315753:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329471360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782229000.315816:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229000.315882:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329471360 00000100:00100000:3.0:1782229000.315890:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329471360 00000100:00100000:3.0:1782229000.315942:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782229000.315952:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329471360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782229000.315986:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782229000.318981:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329471360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3022us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229000.318996:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1782229000.319031:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c8a300 x1868802329471360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229000.319050:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329471360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782229000.572008:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229000.774206:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229000.774253:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229000.774339:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513344 00000100:00100000:2.0:1782229000.774347:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513472 00000100:00100000:3.0:1782229000.774348:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513344 00000100:00100000:2.0:1782229000.774350:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513472 00000100:00100000:2.0:1782229000.774399:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 120 00000100:00100000:3.0:1782229000.774400:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 281 00000100:00100000:3.0:1782229000.774409:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2371:x1868802309513344:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229000.774409:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2371:x1868802309513472:12345-192.168.204.22@tcp:400:kworker.0 00000100:00080000:0.0:1782229000.774576:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229000.774710:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2371:x1868802309513472:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 301us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229000.774718:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 120 00000100:00100000:3.0:1782229000.775452:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2371:x1868802309513344:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 1020us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229000.775460:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 281 00000100:00100000:0.0:1782229000.782045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229000.782125:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513728 00000100:00100000:2.0:1782229000.782134:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513728 00000100:00100000:2.0:1782229000.782203:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 121 00000100:00100000:2.0:1782229000.782213:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309513728:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229000.782314:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2371:x1868802309513728:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229000.782322:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 121 00000100:00080000:0.0:1782229000.782388:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229000.784235:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229000.784707:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513600 00000100:00100000:2.0:1782229000.784716:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513600 00000100:00100000:2.0:1782229000.784822:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:2.0:1782229000.784833:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2369:x1868802309513600:12345-192.168.204.22@tcp:9:kworker.0 00000020:00000080:2.0:1782229000.784861:0:8488:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e638e4 00000100:00080000:2.0:1782229000.784870:0:8488:0:(import.c:65:import_set_state_nolock()) ffff98fe77c59000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782229000.784915:0:8488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1782229000.785183:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+2:2369:x1868802309513600:12345-192.168.204.22@tcp:9:kworker.0 Request processed in 351us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229000.785191:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00010000:00010000:1.0:1782229000.785247:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782229000.785315:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782229001.595699:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782229001.884953:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:1.0:1782229001.884963:0:7508:0:(genops.c:906:class_export_put()) final put ffff98fe77c5b000/2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:1.0:1782229001.884993:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77c5b000/2d74cab1-6977-468d-a933-6ac020ef49f3 for lustre-OST0001 00000020:00000080:1.0:1782229001.885039:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe77c59000 for lustre-OST0001 00010000:00010000:1.0:1782229002.620738:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229003.649388:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229004.672462:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229004.925977:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782229004.926007:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329471488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229004.926087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229004.926143:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329471872:0@lo:400:kworker.0 00000100:00100000:0.0:1782229004.926171:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329471616:0@lo:400:kworker.0 00000100:00100000:0.0:1782229004.926244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229004.926246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229004.926276:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329472128:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.926296:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782229004.926311:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329471744:0@lo:400:kworker.0 00000100:00100000:0.0:1782229004.926320:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229004.926362:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229004.926364:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782229004.926374:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329472000:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.926393:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329472256:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.926420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229004.926480:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329471872 00000100:00100000:1.0:1782229004.926489:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329471872 00000100:00100000:1.0:1782229004.926557:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472128 00000100:00100000:1.0:1782229004.926561:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472128 00000100:00100000:1.0:1782229004.926578:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329471744 00000100:00100000:1.0:1782229004.926580:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329471744 00000100:00100000:1.0:1782229004.926600:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782229004.926614:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229004.926617:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329471872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.926693:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329471872:12345-0@lo:400:kworker.0 Request processed in 83us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229004.926702:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782229004.926722:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1782229004.926729:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329472128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.926788:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329472128:12345-0@lo:400:kworker.0 Request processed in 58us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229004.926794:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1782229004.926806:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782229004.926812:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329471744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229004.926819:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329471488 00000100:00100000:0.0:1782229004.926829:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329471488 00000100:00100000:1.0:1782229004.926842:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329471744:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229004.926850:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782229004.926875:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472256 00000100:00100000:1.0:1782229004.926880:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472256 00000100:00100000:1.0:1782229004.926915:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472000 00000100:00100000:1.0:1782229004.926918:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472000 00000100:00100000:1.0:1782229004.926940:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782229004.926947:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329472256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.926978:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329472256:12345-0@lo:400:kworker.0 Request processed in 31us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229004.926984:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782229004.926994:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782229004.927000:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329472000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.927025:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329472000:12345-0@lo:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229004.927031:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782229004.927085:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329471744:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.927098:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329472256:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.927108:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329471872:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.927180:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329471616 00000100:00100000:1.0:1782229004.927184:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329471616 00000100:00100000:1.0:1782229004.927225:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1782229004.927232:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329471616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.927262:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329471616:12345-0@lo:400:kworker.0 Request processed in 31us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229004.927268:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1782229004.927309:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782229004.927314:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782229004.927317:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782229004.927344:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73f67480 x1868802329472000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782229020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229004.927356:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329472000:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.927366:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329471616:0@lo:400:kworker.0 00000100:00100000:1.0:1782229004.927377:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329472128:0@lo:400:kworker.0 00000100:00100000:0.0:1782229004.927643:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782229004.927666:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329471488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782229004.927845:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229004.927907:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329471488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 245us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229004.927914:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782229004.928000:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329471488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782229005.436536:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329472384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782229005.436611:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229005.436696:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472384 00000100:00100000:2.0:1782229005.436704:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472384 00000100:00100000:2.0:1782229005.436761:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782229005.436770:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329472384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782229005.436803:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229005.436846:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329472384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229005.436853:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1782229005.436890:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c8a300 x1868802329472384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782229005.436911:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329472384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782229005.691803:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229005.887729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229005.887795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229005.887840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229005.887919:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513984 00000100:00100000:0.0:1782229005.887919:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309513856 00000100:00100000:2.0:1782229005.887935:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513984 00000100:00100000:0.0:1782229005.887935:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309513856 00000100:00100000:2.0:1782229005.888002:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309514112 00000100:00100000:2.0:1782229005.888005:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309514112 00000100:00100000:0.0:1782229005.888005:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 283 00000100:00100000:0.0:1782229005.888015:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309513856:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229005.888025:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 125 00000100:00100000:2.0:1782229005.888032:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309513984:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229005.888120:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309513984:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 87us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229005.888127:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 125 00000100:00100000:2.0:1782229005.888155:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 126 00000100:00100000:2.0:1782229005.888161:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309514112:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229005.888196:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309514112:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 34us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229005.888202:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 126 00000100:00080000:3.0:1782229005.888847:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229005.889325:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309513856:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 1308us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229005.889338:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 283 00010000:00010000:1.0:1782229006.715907:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229007.739970:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229008.763719:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782229008.956112:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782229009.787683:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782229009.800208:0:11717:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:36:48 (1782229008) 00000100:00100000:1.0:1782229010.044747:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329472512:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.044899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229010.044944:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329473024:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.044970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229010.044995:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782229010.045001:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329472640:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.045036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229010.045052:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329473152:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.045085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229010.045126:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329472768:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.045148:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229010.046014:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782229010.046025:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329472896:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.046057:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229010.046105:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472512 00000100:00100000:1.0:1782229010.046112:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472512 00000100:00100000:1.0:1782229010.046974:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1782229010.046995:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329472512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.047065:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329472512:12345-0@lo:400:kworker.0 Request processed in 79us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229010.047072:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1782229010.047129:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329473024 00000100:00100000:1.0:1782229010.047134:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329473024 00000100:00100000:1.0:1782229010.047764:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472640 00000100:00100000:1.0:1782229010.047841:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472640 00000100:00100000:1.0:1782229010.047870:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472768 00000100:00100000:1.0:1782229010.047874:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472768 00000100:00100000:1.0:1782229010.047897:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782229010.047919:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329473024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.047975:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329473024:12345-0@lo:400:kworker.0 Request processed in 71us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229010.047983:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782229010.047998:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782229010.048020:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329472640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.048065:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329472640:12345-0@lo:400:kworker.0 Request processed in 47us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229010.048074:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782229010.048086:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782229010.048092:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329472768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.048135:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329472768:12345-0@lo:400:kworker.0 Request processed in 45us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229010.048141:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782229010.048381:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329473152 00000100:00100000:1.0:1782229010.048386:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329473152 00000100:00100000:0.0:1782229010.048545:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329472640:0@lo:400:kworker.0 00000100:00100000:0.0:1782229010.048570:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329472512:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.048572:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329472896 00000100:00100000:1.0:1782229010.048580:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329472896 00000100:00100000:0.0:1782229010.048595:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329473024:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.048610:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782229010.048620:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329473152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229010.048668:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782229010.048686:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329472896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.048890:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329473152:12345-0@lo:400:kworker.0 Request processed in 58us (3590us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229010.048900:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1782229010.048927:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782229010.048931:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782229010.048934:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229010.048958:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329473280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229010.049002:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229010.049053:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329472768:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.049122:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329473152:0@lo:400:kworker.0 00000100:00100000:1.0:1782229010.049146:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329473280 00000100:00100000:1.0:1782229010.049160:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329473280 00000100:00100000:1.0:1782229010.049976:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782229010.049987:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329473280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782229010.050023:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229010.050082:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329473280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229010.050089:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782229010.050160:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329473280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229010.050962:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329472896:12345-0@lo:400:kworker.0 Request processed in 2275us (4895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229010.050977:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1782229010.051247:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe73f65180 x1868802329472896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782229026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229010.051261:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329472896:0@lo:400:kworker.0 00000100:00100000:3.0:1782229010.556298:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782229010.556331:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329473408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782229010.556446:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229010.556772:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329473408 00000100:00100000:2.0:1782229010.556783:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329473408 00000100:00100000:2.0:1782229010.556867:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782229010.556877:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329473408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782229010.556941:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229010.557007:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329473408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229010.557014:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1782229010.559966:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c8bb80 x1868802329473408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229010.560002:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329473408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782229010.811865:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229011.007574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229011.007618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229011.007714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229011.007779:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309514240 00000100:00100000:0.0:1782229011.007789:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309514240 00000100:00100000:0.0:1782229011.007855:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 285 00000100:00100000:0.0:1782229011.007866:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309514240:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229011.007945:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309514240:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 81us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229011.007953:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 285 00000100:00100000:1.0:1782229011.015350:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309514496 00000100:00100000:1.0:1782229011.015366:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309514496 00000100:00100000:1.0:1782229011.016101:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309514368 00000100:00100000:1.0:1782229011.016109:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309514368 00000100:00100000:0.0:1782229011.016172:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 130 00000100:00100000:0.0:1782229011.016205:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309514496:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229011.016695:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309514496:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 493us (9072us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229011.016704:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 130 00000100:00080000:3.0:1782229011.019116:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229011.023412:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 131 00000100:00100000:0.0:1782229011.023449:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309514368:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229011.023554:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309514368:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 128us (15839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229011.023562:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 131 00000100:00100000:3.0:1782229011.564981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229011.565226:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309514624 00000100:00100000:2.0:1782229011.565237:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309514624 00000100:00100000:2.0:1782229011.565315:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:2.0:1782229011.565326:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:10236:x1868802309514624:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229011.565346:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229011.565369:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e639af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949718 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.565459:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e639b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.565473:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e639b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.565486:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e639b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229011.565684:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782229011.565688:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229011.565779:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e639b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.565805:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e639af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949718 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.565849:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e639b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949718 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.565858:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe58dddd00) 00010000:00010000:2.0:1782229011.565861:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229011.565864:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcdc00, rc 0) 00000100:00100000:2.0:1782229011.565935:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:10236:x1868802309514624:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 610us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229011.565943:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:3.0:1782229011.579081:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229011.579267:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309514752 00000100:00100000:2.0:1782229011.579284:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309514752 00000100:00100000:2.0:1782229011.579352:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:2.0:1782229011.579363:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:10237:x1868802309514752:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229011.579381:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229011.579401:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e639bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994971f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579491:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579505:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579517:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579531:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579546:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579553:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579953:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd000/0x8e1c8a3488e639d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579962:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd000/0x8e1c8a3488e639d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.579969:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd000/0x8e1c8a3488e639d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229011.580058:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782229011.580141:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229011.580217:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd000/0x8e1c8a3488e639d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580228:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580233:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580239:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580245:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229011.580248:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580260:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580271:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe58dddd00) 00010000:00010000:2.0:1782229011.580274:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229011.580278:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580283:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e639c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580294:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580300:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580305:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580310:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229011.580312:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580317:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580323:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98fe58ddd500) 00010000:00010000:2.0:1782229011.580326:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229011.580328:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580343:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e639cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580377:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e639bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994971f expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580390:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd000/0x8e1c8a3488e639d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994971f expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.580398:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98fe58ddde00) 00010000:00010000:2.0:1782229011.580400:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229011.580402:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd000, rc 0) 00000100:00100000:2.0:1782229011.580517:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:10237:x1868802309514752:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 1154us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229011.580524:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:3.0:1782229011.584209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229011.585180:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309515008 00000100:00100000:2.0:1782229011.585191:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309515008 00000100:00100000:2.0:1782229011.585283:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:2.0:1782229011.585293:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:10237:x1868802309515008:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229011.585314:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229011.585336:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e639d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949726 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.585412:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.585426:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.585482:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.585542:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.585551:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.585557:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590148:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcca00/0x8e1c8a3488e639ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590184:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcca00/0x8e1c8a3488e639ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590197:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcca00/0x8e1c8a3488e639ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229011.590498:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782229011.590752:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590761:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590769:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590775:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcde00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229011.590787:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590794:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590808:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98fe58ddde00) 00010000:00010000:2.0:1782229011.590810:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229011.590814:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590820:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e639e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590850:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590857:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590863:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590868:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcda00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229011.590871:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590876:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590884:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98fe58ddd300) 00010000:00010000:2.0:1782229011.590886:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229011.590896:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.590902:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e639e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.593708:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e639d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949726 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.593732:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcca00/0x8e1c8a3488e639ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949726 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229011.593741:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:2.0:1782229011.593744:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229011.593747:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcca00, rc 0) 00000100:00100000:2.0:1782229011.593823:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:10237:x1868802309515008:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 8530us (9622us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782229011.593833:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:1.0:1782229011.610543:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229011.613677:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309515136 00000100:00100000:2.0:1782229011.613693:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309515136 00000100:00100000:3.0:1782229011.614146:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:3.0:1782229011.614160:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+9:10237:x1868802309515136:12345-192.168.204.22@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782229011.614303:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+9:10237:x1868802309515136:12345-192.168.204.22@tcp:59:lhsmtool_posix.0 Request processed in 147us (3770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229011.614310:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 35 00010000:00010000:1.0:1782229011.839900:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782229012.028526:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1782229012.153526:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1782229012.860901:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229013.587001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229013.587208:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309515264 00000100:00100000:0.0:1782229013.587218:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309515264 00000100:00100000:0.0:1782229013.587383:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:0.0:1782229013.587395:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+8:10280:x1868802309515264:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229013.587415:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229013.587544:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e639fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994972d expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587616:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587631:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587645:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587672:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587681:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587688:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587945:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587953:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587960:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587965:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a0c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229013.587970:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587977:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.587989:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe58dddd00) 00010000:00010000:0.0:1782229013.587992:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229013.587996:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588002:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588020:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588190:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588196:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588202:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a1a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229013.588205:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588211:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588219:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98fe42cb9800) 00010000:00010000:0.0:1782229013.588221:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229013.588224:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588230:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588266:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e639fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994972d expref: 9 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588276:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe58dddd00) 00010000:00010000:0.0:1782229013.588278:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229013.588392:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e639fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994972d expref: 9 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.588404:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe414a1e00, rc 0) 00000100:00100000:0.0:1782229013.588612:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+8:10280:x1868802309515264:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1220us (1621us total) trans 0 rc 301/301 00000100:00100000:0.0:1782229013.588619:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00080000:3.0:1782229013.588707:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229013.594160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229013.594265:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309515520 00000100:00100000:0.0:1782229013.594275:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309515520 00000100:00100000:0.0:1782229013.594391:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 37 00000100:00100000:0.0:1782229013.594401:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:10280:x1868802309515520:12345-192.168.204.22@tcp:36:lfs.0 00010000:00010000:0.0:1782229013.595123:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229013.595161:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e639b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949718 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.595177:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe58dddd00) 00010000:00010000:0.0:1782229013.595187:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229013.595819:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.595835:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.595844:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.595854:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.595861:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.595873:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229013.597832:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782229013.597847:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.597856:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.597864:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.597869:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a1e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229013.597874:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.597881:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.597897:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:0.0:1782229013.597900:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229013.597905:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.597911:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a11 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229013.597934:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f86fca98 reply state 000000004d7b9919 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229013.597955:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229013.598082:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+9:10280:x1868802309515520:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 3678us (3939us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782229013.598100:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 37 00010000:00010000:1.0:1782229013.602819:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.602837:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.602844:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.602924:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a1a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229013.602931:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.602948:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.602965:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98fe42cb9d00) 00010000:00010000:1.0:1782229013.602968:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229013.602972:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.602979:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a18 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229013.703901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229013.704083:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309515648 00000100:00100000:1.0:1782229013.704093:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309515648 00000100:00100000:1.0:1782229013.704158:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:1.0:1782229013.704170:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:10288:x1868802309515648:12345-192.168.204.22@tcp:101:lctl.0 00010000:00010000:1.0:1782229013.704195:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229013.704255:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949734 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.704336:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.704349:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.704360:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229013.704424:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782229013.704475:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229013.704520:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.704566:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949734 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.704588:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949734 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.705167:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:0.0:1782229013.705171:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229013.705188:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe414a0c00, rc 0) 00000100:00100000:0.0:1782229013.705398:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:10288:x1868802309515648:12345-192.168.204.22@tcp:101:lctl.0 Request processed in 1229us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229013.705406:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:2.0:1782229013.767095:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229013.767911:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309515776 00000100:00100000:3.0:1782229013.767927:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309515776 00000100:00100000:3.0:1782229013.768004:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:3.0:1782229013.768016:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+9:10294:x1868802309515776:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229013.768218:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229013.768317:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63a2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994973b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768401:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768419:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768467:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768486:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768495:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768526:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768694:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63a42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768703:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.768836:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229013.769006:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782229013.769011:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229013.769345:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769361:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769368:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769375:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769381:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229013.769385:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769393:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769418:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:3.0:1782229013.769421:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229013.769427:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769460:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63a34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769478:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769484:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769490:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769494:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229013.769497:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769503:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769510:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98fe43933b00) 00010000:00010000:3.0:1782229013.769513:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229013.769516:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769522:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63a3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769582:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63a2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994973b expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769598:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63a42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994973b expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.769606:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:3.0:1782229013.769608:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782229013.769611:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916400, rc 0) 00000100:00100000:3.0:1782229013.769804:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+10:10294:x1868802309515776:12345-192.168.204.22@tcp:101:bash.0 Request processed in 1788us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229013.769815:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:1.0:1782229013.774912:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229013.775107:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309516032 00000100:00100000:0.0:1782229013.775121:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309516032 00000100:00100000:0.0:1782229013.775215:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 40 00000100:00100000:0.0:1782229013.775542:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+10:10294:x1868802309516032:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229013.775577:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229013.775608:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949742 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.775817:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.775834:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.775850:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.779758:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.779785:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.779800:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782229013.781306:0:10359:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1782229013.781553:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.781996:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782008:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782063:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782069:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782076:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782082:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe414a1a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229013.782086:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782094:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782106:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229013.782110:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229013.782115:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782120:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1a00/0x8e1c8a3488e63a50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229013.782166:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b80b6c1 reply state 000000006d082737 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229013.782176:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782229013.782219:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a1e00/0x8e1c8a3488e63a49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 13 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782235:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 12 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.782243:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229013.782245:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229013.782248:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23200, rc 0) 00000100:00100000:0.0:1782229013.782347:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10294:x1868802309516032:12345-192.168.204.22@tcp:101:bash.0 Request processed in 6813us (7450us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782229013.782356:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 40 00010000:00010000:3.0:1782229013.786379:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.786397:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.786405:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.786412:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229013.786417:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.786426:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.786671:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe42cb9700) 00010000:00010000:3.0:1782229013.786689:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229013.786694:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.786702:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e63a57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229013.789958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229013.790050:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309516160 00000100:00100000:3.0:1782229013.790060:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309516160 00000100:00100000:3.0:1782229013.790112:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:3.0:1782229013.790120:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2369:x1868802309516160:12345-192.168.204.22@tcp:8:bash.0 00010000:00080000:3.0:1782229013.790151:0:6600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:3.0:1782229013.790195:0:6600:0:(genops.c:1406:class_connect()) connect: client 2d74cab1-6977-468d-a933-6ac020ef49f3, cookie 0x8e1c8a3488e63a6c 00002000:00100000:3.0:1782229013.790209:0:6600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2d74cab1-6977-468d-a933-6ac020ef49f3/ffff98fe452e0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782229013.790234:0:6600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782229013.790718:0:6600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782229013.790748:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe452e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782229013.790859:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2369:x1868802309516160:12345-192.168.204.22@tcp:8:bash.0 Request processed in 736us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229013.790867:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:3.0:1782229013.798582:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229013.798694:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309516288 00000100:00100000:1.0:1782229013.798704:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309516288 00000100:00100000:1.0:1782229013.798774:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00100000:1.0:1782229013.798784:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:0:x1868802309516288:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229013.798802:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229013.798828:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949749 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782229013.798855:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229013.798896:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1782229013.798903:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229013.798914:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.798935:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229013.799016:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421400, rc 0) 00000100:00100000:1.0:1782229013.799087:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:0:x1868802309516288:12345-192.168.204.22@tcp:101:bash.0 Request processed in 304us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229013.799095:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00080000:3.0:1782229013.799267:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229013.804575:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229013.804697:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309516416 00000100:00100000:3.0:1782229013.804707:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309516416 00000100:00100000:3.0:1782229013.804763:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:3.0:1782229013.804772:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:10294:x1868802309516416:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229013.804792:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229013.804827:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949750 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.804858:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.804868:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229013.804871:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229013.804876:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 8 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.804908:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.804923:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 8 pid: 6598 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229013.804936:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe59e57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6600:1868802329473536:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229013.805042:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1782229013.813655:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe59e57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6600:1868802329473536:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229013.813693:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 8 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.813716:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916e00, rc 0) 00000100:00100000:3.0:1782229013.813792:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:10294:x1868802309516416:12345-192.168.204.22@tcp:101:bash.0 Request processed in 9020us (9240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229013.813819:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:2.0:1782229013.820835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229013.821128:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309516544 00000100:00100000:3.0:1782229013.821139:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309516544 00010000:00010000:3.0:1782229013.821193:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 8 pid: 6598 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229013.821243:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:3.0:1782229013.821254:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2372:x1868802309516544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229013.821270:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229013.821294:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 8 pid: 6598 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.821311:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 8 pid: 6598 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.821348:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e63a73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949749 expref: 8 pid: 6598 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.821364:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229013.821368:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229013.821375:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.821385:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229013.821492:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229013.821507:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe59e57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5781:1868802329473664:192.168.204.22@tcp:105: 00000100:00100000:3.0:1782229013.822039:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1782229013.826250:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe59e57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5781:1868802329473664:192.168.204.22@tcp:105: 00010000:00010000:3.0:1782229013.826285:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229013.826365:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309516544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 5111us (5543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229013.826375:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:1.0:1782229013.827881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229013.828033:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309516800 00000100:00100000:2.0:1782229013.828041:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309516800 00000100:00100000:2.0:1782229013.828097:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:2.0:1782229013.828106:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+12:10294:x1868802309516800:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:2.0:1782229013.828778:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10294:x1868802309516800:12345-192.168.204.22@tcp:35:bash.0 Request processed in 671us (904us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782229013.828786:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00010000:00010000:1.0:1782229013.883886:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229013.940701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229013.941278:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309517056 00000100:00100000:0.0:1782229013.941292:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309517056 00000100:00100000:0.0:1782229013.941418:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 41 00000100:00100000:0.0:1782229013.941475:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10304:x1868802309517056:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229013.941511:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229013.941537:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63a81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949757 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229013.941697:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782229013.941862:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63a81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949757 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.941898:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:0.0:1782229013.941901:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782229013.941908:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63a81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949757 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229013.941927:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23400, rc 0) 00000100:00100000:0.0:1782229013.942013:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+14:10304:x1868802309517056:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 585us (1327us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1782229013.942034:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 41 00000100:00100000:2.0:1782229013.947078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229013.947626:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309517312 00000100:00100000:0.0:1782229013.947641:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309517312 00000100:00100000:0.0:1782229013.947863:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:0.0:1782229013.947877:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+14:10304:x1868802309517312:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229013.948302:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:10304:x1868802309517312:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 425us (1243us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782229013.948312:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:1.0:1782229014.021504:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229014.021633:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309517440 00000100:00100000:2.0:1782229014.021643:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309517440 00000100:00100000:2.0:1782229014.021750:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:2.0:1782229014.021762:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:10310:x1868802309517440:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229014.021788:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229014.021819:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63a8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994975e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.022132:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.022146:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.022159:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229014.022222:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782229014.022226:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229014.022258:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.022286:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63a8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994975e expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.022322:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994975e expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.022331:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229014.022334:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229014.022338:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcde00, rc 0) 00000100:00100000:2.0:1782229014.022512:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+16:10310:x1868802309517440:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 752us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229014.022520:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:3.0:1782229014.029282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.029381:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309517696 00000100:00100000:0.0:1782229014.029395:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309517696 00000100:00100000:0.0:1782229014.029494:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:0.0:1782229014.029503:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+16:10310:x1868802309517696:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229014.029524:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229014.029545:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63a9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949765 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.029651:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63aa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.029679:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.029690:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229014.029703:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782229014.030166:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63a9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949765 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.030185:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949765 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.030194:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229014.030197:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229014.030201:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22400, rc 0) 00000100:00100000:0.0:1782229014.030275:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+18:10310:x1868802309517696:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 773us (1017us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1782229014.030283:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:3.0:1782229014.034909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.035058:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309517952 00000100:00100000:0.0:1782229014.035077:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309517952 00000100:00100000:0.0:1782229014.035189:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:0.0:1782229014.035207:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+18:10310:x1868802309517952:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229014.035266:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229014.035305:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e63ab2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994976c expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.035991:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63ab9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.036424:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.036744:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63ab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229014.036784:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782229014.038049:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e63ab2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994976c expref: 21 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.038082:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63ab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994976c expref: 20 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.038092:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229014.038096:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782229014.038100:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22600, rc 0) 00000100:00100000:0.0:1782229014.038207:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+20:10310:x1868802309517952:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 3005us (3310us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782229014.038226:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:3.0:1782229014.038959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229014.039103:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309518080 00000100:00100000:2.0:1782229014.039119:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309518080 00000100:00100000:2.0:1782229014.039214:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:2.0:1782229014.039225:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+20:2371:x1868802309518080:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229014.039241:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229014.039267:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63aa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949765 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.039286:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229014.039290:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229014.039344:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+19:2371:x1868802309518080:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 122us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229014.039351:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:3.0:1782229014.044799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229014.045099:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309518208 00000100:00100000:1.0:1782229014.045113:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309518208 00000100:00100000:1.0:1782229014.045238:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:1.0:1782229014.045253:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309518208:12345-192.168.204.22@tcp:1:lfs.0 00010000:00010000:1.0:1782229014.045332:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.045358:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.045369:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782229014.045374:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229014.045398:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.045472:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.045491:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229014.045510:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6598:1868802329473792:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229014.045636:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782229014.053497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.053726:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309518336 00000100:00100000:0.0:1782229014.053737:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309518336 00002000:00100000:0.0:1782229014.053801:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98fe59e57800 x1868802309518336/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:185/0 lens 504/0 e 0 to 0 dl 1782229025 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782229014.053812:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe59e57800 with x1868802309518336 ext(0->12) 00010000:00010000:0.0:1782229014.053837:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 8 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.053857:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 8 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782229014.053865:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe59e57800 00000100:00100000:0.0:1782229014.053956:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:0.0:1782229014.053967:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309518336:12345-192.168.204.22@tcp:4:lfs.0 00000100:00100000:1.0:1782229014.056128:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6598:1868802329473792:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229014.057037:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1782229014.108158:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000001:00080000:1.0:1782229014.145285:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1782229014.145398:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309518336:12345-192.168.204.22@tcp:4:lfs.0 Request processed in 91426us (91905us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782229014.145419:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00002000:00100000:3.0:1782229014.145462:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98fe59e57800 x1868802309518336/t4294967299(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:185/0 lens 504/448 e 0 to 0 dl 1782229025 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782229014.145474:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe59e57800 with x1868802309518336 ext(0->12) 00010000:00010000:3.0:1782229014.145486:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.145528:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782229014.145537:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe59e57800 00000100:00100000:2.0:1782229014.148261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.148479:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309518464 00000100:00100000:0.0:1782229014.148489:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309518464 00010000:00010000:0.0:1782229014.148531:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229014.148607:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:0.0:1782229014.148617:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2370:x1868802309518464:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229014.148645:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782229014.148665:0:5782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782229014.148667:0:5782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782229014 00002000:00010000:0.0:1782229014.148670:0:5782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782229014 00002000:00010000:0.0:1782229014.148672:0:5782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782229014 00002000:00010000:0.0:1782229014.148674:0:5782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1782229014.148679:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.148695:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.148732:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e63a7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949750 expref: 7 pid: 6600 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.148748:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782229014.148756:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782229014.148762:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.148772:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.148796:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229014.148852:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309518464:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 237us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229014.148860:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 36 00010000:00010000:1.0:1782229014.148929:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.148939:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.148964:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.148973:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.148988:0:6598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.148995:0:6598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229014.148999:0:6598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.149008:0:6598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.149031:0:6598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.149038:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e63ac7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229014.149091:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309518208:12345-192.168.204.22@tcp:1:lfs.0 Request processed in 103842us (104309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229014.149099:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:2.0:1782229014.151566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229014.151672:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309518720 00000100:00100000:1.0:1782229014.151682:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309518720 00000100:00100000:1.0:1782229014.151736:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:1.0:1782229014.151748:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+19:10310:x1868802309518720:12345-192.168.204.22@tcp:35:lfs.0 00000004:00010000:1.0:1782229014.151815:0:5800:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63ab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994976c expref: 19 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782229014.152336:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1782229014.152397:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1782229014.153331:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1782229014.153392:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.153411:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 23 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.153421:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.153557:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 23 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.153576:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 23 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229014.153590:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1868802329473920:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229014.153851:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782229014.163364:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229014.163456:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309518848 00000100:00100000:2.0:1782229014.163465:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309518848 00010000:00010000:2.0:1782229014.163514:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 24 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229014.163548:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 37 00000100:00100000:2.0:1782229014.163556:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2372:x1868802309518848:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229014.163572:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229014.163578:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 24 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.163593:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 24 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.163614:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229014.163620:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.163630:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.163873:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.163894:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229014.163951:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2372:x1868802309518848:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 395us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229014.163959:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 37 00010000:00010000:1.0:1782229014.166084:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949742 expref: 23 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229014.166110:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1868802329473920:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229014.166133:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.166162:0:5800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.166168:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782229014.166317:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1782229014.167943:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1782229014.168132:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329474048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782229014.168224:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229014.168258:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782229014.168326:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329474048 00000100:00100000:2.0:1782229014.168338:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329474048 00000100:00100000:2.0:1782229014.168409:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782229014.168419:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5800:x1868802329474048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782229014.168570:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5800:x1868802329474048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229014.168578:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1782229014.168996:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229014.169734:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329474048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782229014.171362:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1782229014.171562:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bd45500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329474176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782229014.171711:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229014.171747:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe452ae240 going to sleep for 11 seconds 00000100:00100000:1.0:1782229014.171842:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329474176 00000100:00100000:1.0:1782229014.171851:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329474176 00000100:00100000:1.0:1782229014.171954:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782229014.171963:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5800:x1868802329474176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782229014.172227:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5800:x1868802329474176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 260us (585us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782229014.172236:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229014.172310:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bd45500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329474176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782229014.172371:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1782229014.172411:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.172623:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.172630:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.172637:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229014.172641:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.172650:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.172666:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229014.172669:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782229014.172673:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.172679:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63ace lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782229014.172884:0:5800:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782229014.173116:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1782229014.173129:0:5800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327169697848ns, next at 328169695191ns, rc = 0 00000001:00080000:0.0:1782229014.173135:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1782229014.173169:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229014.173171:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782229014.173179:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63ab9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994976c expref: 27 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229014.173287:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+26:10310:x1868802309518720:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 21541us (21730us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782229014.173295:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000020:00080000:0.0:1782229014.173299:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782229014.176934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229014.177108:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309518976 00000100:00100000:2.0:1782229014.177117:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309518976 00000100:00100000:2.0:1782229014.177199:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:2.0:1782229014.177210:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+26:10310:x1868802309518976:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229014.177245:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229014.177269:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63ad5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949773 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.177330:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63ad5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949773 expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.177346:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63ad5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949773 expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229014.177367:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:2.0:1782229014.177371:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782229014.177374:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd600, rc 0) 00000100:00100000:3.0:1782229014.178292:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+27:10310:x1868802309518976:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1079us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229014.178302:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:2.0:1782229014.183932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.184319:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309519232 00000100:00100000:0.0:1782229014.184330:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309519232 00000100:00100000:0.0:1782229014.184474:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:0.0:1782229014.184485:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+27:10310:x1868802309519232:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229014.184746:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+28:10310:x1868802309519232:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 262us (823us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1782229014.184755:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:0.0:1782229014.264539:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229014.264605:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309519488 00000100:00100000:2.0:1782229014.264619:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309519488 00000100:00100000:3.0:1782229014.264747:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:3.0:1782229014.264761:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+28:10320:x1868802309519488:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229014.264978:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229014.265000:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63adc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994977a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229014.265153:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782229014.265482:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63adc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994977a expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.265499:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:3.0:1782229014.265502:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782229014.265509:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63adc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994977a expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.265540:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916800, rc 0) 00000100:00100000:3.0:1782229014.265605:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10320:x1868802309519488:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 847us (1075us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1782229014.265613:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:3.0:1782229014.270723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.271473:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309519616 00000100:00100000:0.0:1782229014.271484:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309519616 00000100:00100000:0.0:1782229014.271541:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:0.0:1782229014.271550:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10320:x1868802309519616:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:0.0:1782229014.271623:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.271639:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.271650:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.271664:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.271688:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.271694:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272660:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272676:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272685:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229014.272793:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272806:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272812:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272819:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272825:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229014.272830:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272838:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272861:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229014.272864:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229014.272870:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272876:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63aea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272889:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272895:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272901:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272907:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229014.272910:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272916:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272923:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe42cb9600) 00010000:00010000:0.0:1782229014.272925:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229014.272928:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272933:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272958:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272964:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272969:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272974:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229014.272977:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272982:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.272989:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229014.272991:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229014.272994:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.273000:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229014.273217:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10320:x1868802309519616:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 1665us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229014.273228:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:2.0:1782229014.276519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229014.276571:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309519872 00000100:00100000:1.0:1782229014.276581:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309519872 00000100:00100000:1.0:1782229014.276683:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:1.0:1782229014.276693:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10320:x1868802309519872:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:1.0:1782229014.276973:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+30:10320:x1868802309519872:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 281us (465us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1782229014.276982:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:2.0:1782229014.315696:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.315816:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309520128 00000100:00100000:0.0:1782229014.315825:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309520128 00000100:00100000:0.0:1782229014.315919:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:0.0:1782229014.315937:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+30:10323:x1868802309520128:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229014.315966:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229014.315988:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63aff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949781 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316070:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316085:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316095:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316109:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316115:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316121:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316507:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316516:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.316523:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229014.316545:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782229014.317081:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317100:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317106:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317112:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229014.317115:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317122:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317143:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229014.317147:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229014.317151:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317157:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317172:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317177:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317192:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317197:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229014.317199:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317205:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317213:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe42cb9600) 00010000:00010000:0.0:1782229014.317215:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229014.317217:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317223:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317273:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63aff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 33 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317288:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 32 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.317295:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229014.317297:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229014.317300:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23800, rc 0) 00000100:00100000:0.0:1782229014.317639:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+32:10323:x1868802309520128:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1703us (1952us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1782229014.317658:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:3.0:1782229014.322580:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.322652:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309520256 00000100:00100000:0.0:1782229014.322662:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309520256 00000100:00100000:0.0:1782229014.322732:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:0.0:1782229014.322742:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+32:10323:x1868802309520256:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:0.0:1782229014.322821:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322837:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322849:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322875:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322882:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322889:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322895:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229014.322900:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322908:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322920:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229014.322938:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782229014.322944:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.322951:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229014.323040:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+32:10323:x1868802309520256:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 298us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229014.323048:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:2.0:1782229014.329967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.330028:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309520512 00000100:00100000:0.0:1782229014.330038:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309520512 00000100:00100000:0.0:1782229014.330169:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:0.0:1782229014.330181:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+32:10323:x1868802309520512:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229014.331350:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+33:10323:x1868802309520512:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 1166us (1400us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1782229014.331362:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:2.0:1782229014.590789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229014.591064:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309520768 00000100:00100000:3.0:1782229014.591074:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309520768 00000100:00100000:3.0:1782229014.591139:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:3.0:1782229014.591150:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+33:10354:x1868802309520768:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:3.0:1782229014.591176:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229014.591199:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949788 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.591312:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.591399:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.591413:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229014.591426:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782229014.591599:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949788 expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.591632:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949788 expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.591641:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229014.591644:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782229014.591647:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917c00, rc 0) 00000100:00100000:3.0:1782229014.592101:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+35:10354:x1868802309520768:12345-192.168.204.22@tcp:101:cat.0 Request processed in 952us (1321us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1782229014.592109:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:0.0:1782229014.598247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.598294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229014.598458:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309521152 00000100:00100000:1.0:1782229014.598481:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309521152 00000100:00100000:1.0:1782229014.598541:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:1.0:1782229014.598551:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+35:10354:x1868802309521152:12345-192.168.204.22@tcp:35:cat.0 00000100:00100000:1.0:1782229014.599162:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+36:10354:x1868802309521152:12345-192.168.204.22@tcp:35:cat.0 Request processed in 610us (863us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1782229014.599171:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:3.0:1782229014.599252:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309520896 00000100:00100000:3.0:1782229014.599257:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309520896 00000100:00100000:3.0:1782229014.599303:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:3.0:1782229014.599312:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+36:2370:x1868802309520896:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229014.599323:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229014.599357:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949788 expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.599376:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229014.599381:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229014.599404:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+35:2370:x1868802309520896:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 94us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229014.599411:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:2.0:1782229014.662874:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.667139:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309521408 00000100:00100000:0.0:1782229014.667154:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309521408 00000100:00100000:0.0:1782229014.667375:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:0.0:1782229014.667387:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+35:10360:x1868802309521408:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1782229014.667414:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229014.667417:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782229014.667462:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994975e expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.667504:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229014.667509:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229014.667541:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994978f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.667669:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.667683:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 35 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.667691:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.667724:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 35 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.667741:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 35 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229014.667755:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329474304:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229014.667945:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe452aeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782229014.671198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.671317:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329474304:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229014.671349:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229014.671477:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309521536 00000100:00100000:3.0:1782229014.671485:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309521536 00010000:00010000:3.0:1782229014.671522:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 36 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229014.671578:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:3.0:1782229014.671587:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+36:2372:x1868802309521536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229014.671603:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229014.671609:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 36 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.671622:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 36 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.671646:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63b14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949781 expref: 36 pid: 10359 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.672159:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229014.672165:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.672175:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.672183:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.672220:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229014.672239:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.672253:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229014.672271:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:3.0:1782229014.672283:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+35:2372:x1868802309521536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 696us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229014.672291:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 38 00010000:00010000:0.0:1782229014.672467:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.672483:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 35 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.672489:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229014.672492:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782229014.672493:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22600, rc 0) 00000100:00100000:0.0:1782229014.672517:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+35:10360:x1868802309521408:12345-192.168.204.22@tcp:101:dd.0 Request processed in 5134us (9724us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1782229014.672538:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:1.0:1782229014.678615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.678971:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309521792 00000100:00100000:0.0:1782229014.678985:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309521792 00000100:00100000:0.0:1782229014.679058:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:0.0:1782229014.679069:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+35:10360:x1868802309521792:12345-192.168.204.22@tcp:36:dd.0 00010000:00010000:0.0:1782229014.679424:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.679485:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229014.679498:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782229014.679579:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1782229014.679605:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046fea216 reply state 000000008ad82fb7 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229014.679615:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229014.680197:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+38:10360:x1868802309521792:12345-192.168.204.22@tcp:36:dd.0 Request processed in 1126us (1588us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1782229014.680217:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 52 00000020:00080000:0.0:1782229014.680223:0:10359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782229014.682541:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.682559:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.682567:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.682574:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229014.682580:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.682588:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.682605:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:1.0:1782229014.682608:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229014.682612:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.682619:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63b53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229014.907787:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229014.983422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229014.983552:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309521920 00000100:00100000:3.0:1782229014.983574:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309521920 00000100:00100000:3.0:1782229014.983636:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:3.0:1782229014.983646:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+37:10374:x1868802309521920:12345-192.168.204.22@tcp:101:stat.0 00010000:00010000:3.0:1782229014.983689:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229014.983711:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63b5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949796 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983790:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983805:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983816:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983831:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983839:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983845:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983940:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983952:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983960:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.983995:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229014.984029:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 38 pid: 5798 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229014.984046:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe59e56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329474432:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229014.984145:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1782229014.997150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229014.997246:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309522176 00000100:00100000:0.0:1782229014.997255:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309522176 00000100:00100000:0.0:1782229014.997314:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:0.0:1782229014.997323:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+39:5583:x1868802309522176:12345-192.168.204.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782229014.997684:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+40:5583:x1868802309522176:12345-192.168.204.22@tcp:35:ldlm_bl.0 Request processed in 361us (544us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1782229014.997692:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:3.0:1782229014.997959:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe59e56300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329474432:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229014.997982:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229015.003290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229015.003461:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309522304 00000100:00100000:3.0:1782229015.003472:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309522304 00010000:00010000:3.0:1782229015.003536:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 40 pid: 5798 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229015.003579:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:3.0:1782229015.003591:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+40:2373:x1868802309522304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229015.003605:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229015.003612:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 40 pid: 5798 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.003625:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 40 pid: 5798 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.003665:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63b45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994978f expref: 40 pid: 5798 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782229015.003766:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782229015.004011:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229015.004017:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.004026:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.004033:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.004069:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229015.004127:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+39:2373:x1868802309522304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 539us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229015.004135:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 39 00010000:00010000:1.0:1782229015.004392:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004401:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229015.004481:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782229015.004486:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229015.004527:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004540:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004549:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004555:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004561:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004568:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229015.004572:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004579:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004598:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:1.0:1782229015.004600:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229015.004604:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004610:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63b61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004621:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004626:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004631:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004635:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229015.004637:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004644:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004650:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe43933b00) 00010000:00010000:1.0:1782229015.004652:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229015.004655:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.004660:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.005110:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63b5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949796 expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.005125:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949796 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.005132:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:1.0:1782229015.005134:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229015.005137:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916c00, rc 0) 00000100:00100000:1.0:1782229015.005459:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+38:10374:x1868802309521920:12345-192.168.204.22@tcp:101:stat.0 Request processed in 21786us (22020us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229015.005468:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:2.0:1782229015.084323:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229015.084477:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309522560 00000100:00100000:3.0:1782229015.084491:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309522560 00000100:00100000:3.0:1782229015.084567:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 54 00000100:00100000:3.0:1782229015.084579:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+38:10380:x1868802309522560:12345-192.168.204.22@tcp:36:truncate.0 00010000:00010000:3.0:1782229015.084663:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229015.084701:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63b6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949796 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.084734:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229015.084740:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229015.085063:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.085080:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.085091:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782229015.085150:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1782229015.085176:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f078da5 reply state 000000002cd8547d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229015.085186:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782229015.085406:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+40:10380:x1868802309522560:12345-192.168.204.22@tcp:36:truncate.0 Request processed in 827us (1098us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1782229015.085414:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 54 00000020:00080000:3.0:1782229015.085420:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229015.095782:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.095824:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.095832:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.095839:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229015.095845:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.095854:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.095900:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229015.095903:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229015.095909:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.095917:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e63b76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229015.163947:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329474688:0@lo:400:kworker.0 00000100:00100000:3.0:1782229015.164073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229015.164152:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329475200:0@lo:400:kworker.0 00000100:00100000:3.0:1782229015.164185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229015.164283:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329474816:0@lo:400:kworker.0 00000100:00100000:0.0:1782229015.164370:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329474688 00000100:00100000:0.0:1782229015.164380:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329474688 00000100:00100000:0.0:1782229015.164469:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1782229015.164481:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329474688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229015.164548:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329474688:12345-0@lo:400:kworker.0 Request processed in 70us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229015.164693:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329474688:0@lo:400:kworker.0 00000100:00100000:3.0:1782229015.164713:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782229015.164719:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329474560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782229015.164747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229015.164766:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329475072:0@lo:400:kworker.0 00000100:00100000:3.0:1782229015.164789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229015.164819:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329474560 00000100:00100000:3.0:1782229015.164823:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329474560 00000100:00100000:3.0:1782229015.164865:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782229015.164874:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329474560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782229015.164910:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782229015.164951:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329474560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229015.164957:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782229015.165012:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229015.165037:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329475328:0@lo:400:kworker.0 00000100:00100000:3.0:1782229015.165061:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229015.165079:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782229015.165086:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329474944:0@lo:400:kworker.0 00000100:00100000:3.0:1782229015.165108:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229015.165136:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329475072 00000100:00100000:3.0:1782229015.165140:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329475072 00000100:00100000:3.0:1782229015.165170:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329475328 00000100:00100000:3.0:1782229015.165173:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329475328 00000100:00100000:3.0:1782229015.165190:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782229015.165340:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1782229015.165383:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329475200 00000100:00100000:0.0:1782229015.165388:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329475200 00000100:00100000:0.0:1782229015.165416:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329474816 00000100:00100000:0.0:1782229015.165426:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329474816 00000100:00100000:0.0:1782229015.165465:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329474944 00000100:00100000:0.0:1782229015.165468:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329474944 00000100:00100000:0.0:1782229015.165483:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782229015.165489:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329475200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229015.165526:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329475200:12345-0@lo:400:kworker.0 Request processed in 37us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.165533:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782229015.165544:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782229015.165549:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329474816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229015.165730:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329474816:12345-0@lo:400:kworker.0 Request processed in 179us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.165737:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782229015.165749:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782229015.165755:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329474944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229015.165783:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329474944:12345-0@lo:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.165789:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782229015.165913:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329475072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229015.165950:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329475072:12345-0@lo:400:kworker.0 Request processed in 41us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.165986:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329474944:0@lo:400:kworker.0 00000100:00100000:0.0:1782229015.166013:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329474816:0@lo:400:kworker.0 00000100:00100000:2.0:1782229015.166425:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782229015.166490:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329475328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229015.166743:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329475328:12345-0@lo:400:kworker.0 Request processed in 259us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229015.166753:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782229015.166805:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329474560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782229015.166819:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329475072:0@lo:400:kworker.0 00000100:00100000:2.0:1782229015.166830:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329475200:0@lo:400:kworker.0 00000100:00100000:0.0:1782229015.166879:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329475328:0@lo:400:kworker.0 00000100:00080000:2.0:1782229015.166893:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782229015.166901:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782229015.167784:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782229015.247949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.248651:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309522688 00000100:00100000:1.0:1782229015.248666:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309522688 00000100:00100000:1.0:1782229015.248749:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:1.0:1782229015.248762:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+39:10394:x1868802309522688:12345-192.168.204.22@tcp:101:stat.0 00010000:00010000:1.0:1782229015.248795:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229015.248833:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63b7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994979d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.248923:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.248941:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.248954:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.248989:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249010:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249018:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249143:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249153:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249161:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229015.249208:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1782229015.249213:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229015.249237:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249251:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249262:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249270:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249289:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249296:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229015.249301:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249311:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249326:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:1.0:1782229015.249330:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229015.249336:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249343:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63b84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249495:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249503:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249510:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249623:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229015.249628:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249645:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249654:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe439ad000) 00010000:00010000:1.0:1782229015.249656:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229015.249659:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249665:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63b8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249705:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63b7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 41 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249719:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 40 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.249727:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:1.0:1782229015.249729:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229015.249731:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420400, rc 0) 00000100:00100000:1.0:1782229015.249824:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+40:10394:x1868802309522688:12345-192.168.204.22@tcp:101:stat.0 Request processed in 1063us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229015.249833:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:2.0:1782229015.329675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.330341:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309522944 00000100:00100000:0.0:1782229015.330356:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309522944 00000100:00100000:0.0:1782229015.330497:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:0.0:1782229015.330510:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+40:10404:x1868802309522944:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229015.330558:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229015.330586:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497a4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229015.330744:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782229015.330906:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b99 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497a4 expref: 42 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.330925:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:0.0:1782229015.330929:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782229015.330935:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63b99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497a4 expref: 42 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.330953:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23600, rc 0) 00000100:00100000:0.0:1782229015.331041:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+41:10404:x1868802309522944:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 534us (1379us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1782229015.331049:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:3.0:1782229015.334867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.335075:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309523200 00000100:00100000:0.0:1782229015.335090:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309523200 00000100:00100000:0.0:1782229015.335179:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:0.0:1782229015.335204:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+41:10404:x1868802309523200:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229015.335606:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+42:10404:x1868802309523200:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 415us (751us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1782229015.335615:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:2.0:1782229015.404876:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.405708:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309523456 00000100:00100000:1.0:1782229015.405723:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309523456 00000100:00100000:1.0:1782229015.405809:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:1.0:1782229015.405822:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+42:10410:x1868802309523456:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229015.405877:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229015.405904:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ba7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497ab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.406052:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.406076:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.406085:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.406131:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.406149:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 43 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229015.406166:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf11500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329475456:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229015.407377:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782229015.416277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229015.416616:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309523584 00000100:00100000:3.0:1782229015.416628:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309523584 00010000:00010000:3.0:1782229015.416683:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 44 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229015.416734:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 40 00000100:00100000:3.0:1782229015.416746:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+44:2372:x1868802309523584:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229015.416766:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229015.416773:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 44 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.416793:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 44 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.416839:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229015.416845:0:11530:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.416856:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.416864:0:11530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.416889:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229015.416973:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+44:2372:x1868802309523584:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 228us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229015.416982:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 40 00010000:00010000:1.0:1782229015.417666:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63b92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994979d expref: 43 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229015.417691:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf11500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329475456:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229015.417721:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.417748:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.417754:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229015.417778:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1782229015.417981:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ba7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.418012:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.418020:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:1.0:1782229015.418023:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782229015.418027:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421c00, rc 0) 00000100:00100000:1.0:1782229015.418127:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+43:10410:x1868802309523456:12345-192.168.204.22@tcp:101:bash.0 Request processed in 12309us (13267us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1782229015.418146:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:2.0:1782229015.430682:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.430906:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309523840 00000100:00100000:0.0:1782229015.430919:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309523840 00000100:00100000:0.0:1782229015.431070:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:0.0:1782229015.431100:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+43:10410:x1868802309523840:12345-192.168.204.22@tcp:36:bash.0 00010000:00010000:0.0:1782229015.431517:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.431539:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.431551:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782229015.431606:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1782229015.431634:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fa7a0e0 reply state 000000004cfcb436 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229015.431643:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229015.431772:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+46:10410:x1868802309523840:12345-192.168.204.22@tcp:36:bash.0 Request processed in 673us (1104us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1782229015.431780:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 58 00000020:00080000:0.0:1782229015.431786:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229015.434645:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.434666:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.434673:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.434680:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229015.434686:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.434695:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.434735:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:3.0:1782229015.434738:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229015.434743:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229015.434749:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229015.440205:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.440703:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309523968 00000100:00100000:0.0:1782229015.440715:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309523968 00000100:00100000:0.0:1782229015.440791:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 59 00000100:00100000:0.0:1782229015.440803:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+45:10410:x1868802309523968:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229015.440838:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229015.440863:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497b2 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.440975:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.441029:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 46 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.441039:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.441084:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 46 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.441102:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 46 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229015.441119:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329475584:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229015.441483:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe452ae180 going to sleep for 11 seconds 00000100:00100000:2.0:1782229015.444105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.444263:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329475584:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229015.444300:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229015.445739:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309524096 00000100:00100000:3.0:1782229015.445754:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309524096 00010000:00010000:0.0:1782229015.445883:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 47 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229015.445942:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 41 00000100:00100000:0.0:1782229015.445952:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+47:2373:x1868802309524096:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229015.445972:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229015.445980:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 47 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.446028:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 47 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.446061:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63bae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ab expref: 47 pid: 5798 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.446083:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229015.446089:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.446101:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.446111:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.446403:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229015.446529:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+46:2373:x1868802309524096:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 577us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.446538:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 41 00010000:00010000:2.0:1782229015.447742:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229015.447773:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229015.447834:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782229015.447839:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229015.447865:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229015.447910:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497b2 expref: 46 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229015.447931:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497b2 expref: 45 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229015.447940:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:2.0:1782229015.447944:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229015.447947:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22c00, rc 0) 00000100:00100000:2.0:1782229015.448071:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+45:10410:x1868802309523968:12345-192.168.204.22@tcp:101:bash.0 Request processed in 7271us (7890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229015.448080:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 59 00000100:00100000:0.0:1782229015.452735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.452819:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309524352 00000100:00100000:1.0:1782229015.452834:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309524352 00000100:00100000:1.0:1782229015.452909:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:1.0:1782229015.452920:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f08c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+45:10410:x1868802309524352:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:1.0:1782229015.453805:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f08c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+46:10410:x1868802309524352:12345-192.168.204.22@tcp:35:bash.0 Request processed in 881us (1091us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1782229015.453816:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:0.0:1782229015.521681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.523373:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309524608 00000100:00100000:1.0:1782229015.523392:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309524608 00000100:00100000:1.0:1782229015.523506:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 60 00000100:00100000:1.0:1782229015.523520:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+46:10420:x1868802309524608:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229015.523559:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229015.523711:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497b9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229015.523875:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1782229015.524507:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63bd1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497b9 expref: 48 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.524527:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:1.0:1782229015.524529:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229015.524536:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497b9 expref: 48 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.524555:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420c00, rc 0) 00000100:00100000:1.0:1782229015.525001:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10420:x1868802309524608:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1471us (3321us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1782229015.525011:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 60 00000100:00100000:1.0:1782229015.530938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.531143:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309524736 00000100:00100000:0.0:1782229015.531157:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309524736 00000100:00100000:0.0:1782229015.531241:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:0.0:1782229015.531255:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10420:x1868802309524736:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:0.0:1782229015.531675:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.531717:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.531732:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.531753:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.531761:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.531768:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532261:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532274:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532282:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229015.532345:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532546:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532553:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532716:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532722:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.532726:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532734:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532750:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229015.532753:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229015.532759:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532765:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532781:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532788:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532794:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532799:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.532802:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532818:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532827:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe42cb9600) 00010000:00010000:0.0:1782229015.532830:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229015.532833:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532839:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532857:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532863:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532868:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532873:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.532875:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532881:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532963:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229015.532966:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229015.532971:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.532999:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229015.533550:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10420:x1868802309524736:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 2291us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.533639:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:3.0:1782229015.536011:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.537972:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309524992 00000100:00100000:1.0:1782229015.538003:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309524992 00000100:00100000:1.0:1782229015.538097:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:1.0:1782229015.538110:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10420:x1868802309524992:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:1.0:1782229015.538682:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+48:10420:x1868802309524992:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 572us (2693us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1782229015.538711:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:2.0:1782229015.589979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.591045:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309525248 00000100:00100000:0.0:1782229015.591062:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309525248 00000100:00100000:0.0:1782229015.591489:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:0.0:1782229015.591504:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+48:10423:x1868802309525248:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229015.591540:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229015.591582:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497c0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591686:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591706:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591719:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591737:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591745:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591776:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591952:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63c09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591962:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63c09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.591969:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63c09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229015.591981:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782229015.595735:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595761:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595771:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595778:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.595784:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595794:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595819:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229015.595823:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229015.595855:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595862:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63bfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595955:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595963:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595970:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595976:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.595979:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.595996:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.596006:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe42cb9600) 00010000:00010000:0.0:1782229015.596008:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229015.596012:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.596018:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63c02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.596112:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63bf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497c0 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.596227:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63c09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497c0 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.596236:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229015.596238:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229015.596241:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23600, rc 0) 00000100:00100000:0.0:1782229015.596780:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10423:x1868802309525248:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 5276us (6811us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1782229015.596791:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:2.0:1782229015.601707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.602009:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309525376 00000100:00100000:0.0:1782229015.602022:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309525376 00000100:00100000:0.0:1782229015.602305:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:0.0:1782229015.602318:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10423:x1868802309525376:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:0.0:1782229015.602495:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602519:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602535:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602705:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602714:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602735:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602742:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.602748:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602756:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602771:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229015.602775:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782229015.602780:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.602787:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63c17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229015.602878:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10423:x1868802309525376:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 561us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.602898:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:3.0:1782229015.603693:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229015.603778:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309525504 00000100:00100000:2.0:1782229015.603786:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309525504 00000100:00100000:2.0:1782229015.603839:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:2.0:1782229015.603847:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+50:2371:x1868802309525504:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229015.603862:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229015.603890:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63c09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497c0 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229015.603907:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:2.0:1782229015.603912:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229015.603950:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+49:2371:x1868802309525504:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229015.603958:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:2.0:1782229015.607006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229015.607127:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309525760 00000100:00100000:3.0:1782229015.607145:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309525760 00000100:00100000:3.0:1782229015.610035:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:3.0:1782229015.610069:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+49:10423:x1868802309525760:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229015.610411:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10423:x1868802309525760:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 359us (3427us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1782229015.610421:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:0.0:1782229015.675820:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1782229015.676009:0:6963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328672577281ns, next at 329672574160ns, rc = 0 00000100:00100000:0.0:1782229015.677294:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329475712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782229015.677690:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229015.678040:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329475712 00000100:00100000:3.0:1782229015.678052:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329475712 00000100:00100000:3.0:1782229015.678176:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782229015.678205:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329475712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782229015.678253:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782229015.678379:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329475712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229015.678388:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782229015.678938:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329475712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782229015.775934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.776048:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309526016 00000100:00100000:1.0:1782229015.776061:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309526016 00000100:00100000:1.0:1782229015.776140:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:1.0:1782229015.776154:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10441:x1868802309526016:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:1.0:1782229015.776195:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229015.776224:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497c7 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.776672:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63c25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.776693:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63c25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.776709:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63c25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229015.776725:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782229015.776900:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497c7 expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.776924:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63c25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497c7 expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.776935:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:1.0:1782229015.776946:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782229015.776951:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420400, rc 0) 00000100:00100000:1.0:1782229015.777045:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10441:x1868802309526016:12345-192.168.204.22@tcp:101:cat.0 Request processed in 894us (1125us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1782229015.777054:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:0.0:1782229015.807881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.808024:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309526144 00000100:00100000:1.0:1782229015.808042:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309526144 00000100:00100000:1.0:1782229015.808124:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 65 00000100:00100000:1.0:1782229015.808139:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10442:x1868802309526144:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229015.808173:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229015.808961:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497ce expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.809504:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63c3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.809526:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.809543:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229015.809640:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1782229015.809644:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229015.809675:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.809834:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ce expref: 54 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.810347:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ce expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.810361:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:1.0:1782229015.810365:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782229015.810371:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420000, rc 0) 00000100:00100000:1.0:1782229015.810589:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10442:x1868802309526144:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 2451us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229015.810600:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 65 00000100:00100000:2.0:1782229015.827153:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.827403:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309526528 00000100:00100000:1.0:1782229015.827416:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309526528 00000100:00100000:1.0:1782229015.827542:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:1.0:1782229015.827555:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10442:x1868802309526528:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:1.0:1782229015.827974:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10442:x1868802309526528:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 419us (836us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1782229015.827996:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:3.0:1782229015.831222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229015.831404:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309526656 00000100:00100000:1.0:1782229015.831416:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309526656 00000100:00100000:1.0:1782229015.831533:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:1.0:1782229015.831545:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10442:x1868802309526656:12345-192.168.204.22@tcp:103:lfs.0 00010000:00010000:1.0:1782229015.831565:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782229015.831598:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e63bca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497b2 expref: 54 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.831628:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e63c25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497c7 expref: 53 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.831666:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63ad5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949773 expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229015.831679:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd700) 00010000:00010000:1.0:1782229015.831691:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229015.831780:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+51:10442:x1868802309526656:12345-192.168.204.22@tcp:103:lfs.0 Request processed in 237us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229015.831790:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:0.0:1782229015.846015:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229015.847572:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309526784 00000100:00100000:3.0:1782229015.847592:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309526784 00000100:00100000:2.0:1782229015.847837:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:2.0:1782229015.847851:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+51:10442:x1868802309526784:12345-192.168.204.22@tcp:58:lfs.0 00010000:00010000:2.0:1782229015.848057:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229015.848078:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229015.848093:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229015.848813:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782229015.849555:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1782229015.849641:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1782229015.849872:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+51:10442:x1868802309526784:12345-192.168.204.22@tcp:58:lfs.0 Request processed in 2018us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229015.849885:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:2.0:1782229015.885473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229015.885568:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309526912 00000100:00100000:0.0:1782229015.885579:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309526912 00000100:00100000:0.0:1782229015.885656:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 67 00000100:00100000:0.0:1782229015.885693:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+51:10444:x1868802309526912:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229015.885772:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229015.885802:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63c48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497d5 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.885898:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.885917:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.885930:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.885947:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.885954:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.885961:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886103:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886112:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886119:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229015.886176:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782229015.886181:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229015.886275:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886290:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886300:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886306:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886313:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886319:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.886324:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886332:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886346:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229015.886350:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229015.886355:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886362:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63c4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886391:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886397:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886403:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886408:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229015.886411:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886417:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886425:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe42cb9600) 00010000:00010000:0.0:1782229015.886427:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229015.886474:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886481:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886520:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63c48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 53 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886535:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 52 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229015.886555:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd000) 00010000:00010000:0.0:1782229015.886558:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229015.886561:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23800, rc 0) 00000100:00100000:0.0:1782229015.886718:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10444:x1868802309526912:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1028us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229015.886728:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 67 00010000:00010000:0.0:1782229015.933127:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782229016.124028:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782229016.124044:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782229016.124189:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782229016.124199:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782229016.124369:0:11549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe59e55f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329475840:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782229016.124685:0:11549:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1782229016.129965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.130021:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.130062:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.130084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.130131:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309527168 00000100:00100000:2.0:1782229016.130144:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309527168 00000100:00100000:2.0:1782229016.130216:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309527424 00000100:00100000:2.0:1782229016.130220:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309527424 00000100:00100000:2.0:1782229016.130261:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 135 00000100:00100000:2.0:1782229016.130277:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+53:2372:x1868802309527168:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229016.130386:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+53:2372:x1868802309527168:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.130395:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 135 00000100:00100000:2.0:1782229016.130419:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 136 00000100:00100000:2.0:1782229016.130426:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309527424:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229016.130487:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309527424:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 62us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.130497:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 136 00000100:00080000:2.0:1782229016.130700:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229016.130787:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309527296 00000100:00100000:1.0:1782229016.130792:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309527296 00000100:00100000:1.0:1782229016.130847:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:1.0:1782229016.130854:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309527296:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229016.130892:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309527296:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 39us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.130899:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:3.0:1782229016.130998:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309527040 00000100:00100000:3.0:1782229016.131004:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309527040 00000100:00100000:3.0:1782229016.131047:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 287 00000100:00100000:3.0:1782229016.131054:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309527040:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229016.131081:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309527040:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 28us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229016.131088:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 287 00000100:00080000:2.0:1782229016.131655:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782229016.138692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.138808:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309527552 00000100:00100000:0.0:1782229016.138821:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309527552 00000100:00100000:0.0:1782229016.138957:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:0.0:1782229016.138970:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309527552:12345-192.168.204.22@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1782229016.139097:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309527552:12345-192.168.204.22@tcp:900:lhsmtool_posix.0 Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229016.139106:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:3.0:1782229016.139380:0:11549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe59e55f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329475840:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782229016.143390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.143632:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309527680 00000100:00100000:2.0:1782229016.143645:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309527680 00000100:00100000:2.0:1782229016.143715:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 68 00000100:00100000:2.0:1782229016.143726:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10455:x1868802309527680:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782229016.143770:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782229016.143937:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10455:x1868802309527680:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 211us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.143945:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 68 00000100:00100000:2.0:1782229016.148260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.148373:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309527808 00000100:00100000:1.0:1782229016.148385:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309527808 00000100:00100000:1.0:1782229016.148477:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:1.0:1782229016.148490:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10455:x1868802309527808:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782229016.148615:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148638:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148657:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148697:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148705:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148712:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148746:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148755:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148762:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229016.148816:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782229016.148821:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229016.148842:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148858:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148865:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148874:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148890:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229016.148895:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148904:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148919:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:1.0:1782229016.148922:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229016.148928:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148934:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63c64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148948:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148954:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148960:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148965:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229016.148968:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.148984:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149004:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98fe439ad000) 00010000:00010000:1.0:1782229016.149007:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229016.149010:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149017:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c6b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149037:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149043:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149049:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149053:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229016.149056:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149062:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149069:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd000) 00010000:00010000:1.0:1782229016.149071:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229016.149074:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.149079:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.149841:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10455:x1868802309527808:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 Request processed in 1347us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.149853:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:3.0:1782229016.158375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.158658:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309528064 00000100:00100000:2.0:1782229016.158672:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309528064 00000100:00100000:2.0:1782229016.158748:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:2.0:1782229016.158759:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10455:x1868802309528064:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229016.158788:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229016.158815:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63c79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497dc expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.158953:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.158971:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.158996:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229016.159010:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782229016.159142:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.159153:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.159160:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.162088:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.162097:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.162109:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.162130:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd000) 00010000:00010000:2.0:1782229016.162134:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229016.162141:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.162149:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63c80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.162243:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63c79 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497dc expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.162254:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:2.0:1782229016.162256:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229016.162261:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63c79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497dc expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.162271:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcde00, rc 0) 00000100:00100000:2.0:1782229016.162374:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309528064:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 3615us (4013us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1782229016.162386:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:2.0:1782229016.167100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.167212:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309528192 00000100:00100000:1.0:1782229016.167225:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309528192 00000100:00100000:1.0:1782229016.167295:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 71 00000100:00100000:1.0:1782229016.167308:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309528192:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782229016.167372:0:5798:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782229016.167547:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309528192:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 241us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.167556:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 71 00000100:00100000:0.0:1782229016.179762:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.179882:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309528448 00000100:00100000:1.0:1782229016.179895:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309528448 00000100:00100000:1.0:1782229016.179984:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 72 00000100:00100000:1.0:1782229016.179997:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309528448:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229016.180027:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229016.180031:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782229016.180063:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63c3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ce expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.180084:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:1.0:1782229016.180090:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782229016.180105:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497e3 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782229016.181895:0:10359:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1782229016.182199:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.182218:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.182231:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.182306:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63c8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497e3 expref: 55 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.182328:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497e3 expref: 54 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.182337:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229016.182339:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229016.182343:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421a00, rc 0) 00000100:00100000:1.0:1782229016.182903:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10455:x1868802309528448:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 2904us (3151us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1782229016.182915:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 72 00000100:00100000:3.0:1782229016.192334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.192714:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309528704 00000100:00100000:1.0:1782229016.192728:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309528704 00000100:00100000:1.0:1782229016.192830:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 73 00000100:00100000:1.0:1782229016.192844:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10455:x1868802309528704:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782229016.192932:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229016.192992:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e63c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497e3 expref: 54 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.193018:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229016.193031:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782229016.193058:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.193075:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.193087:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196059:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196085:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196097:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196679:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196690:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196698:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196703:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229016.196723:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196731:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196746:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:1.0:1782229016.196749:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229016.196754:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196761:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63ca3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196775:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196781:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196786:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196791:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229016.196794:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196799:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.196806:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7c01ba8 (ffff98fe439ade00) 00010000:00010000:1.0:1782229016.196808:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229016.197634:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.197643:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63caa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7c01ba8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.197765:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309528704:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 4918us (5441us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782229016.197774:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 73 00000100:00100000:2.0:1782229016.201210:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.201944:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309528832 00000100:00100000:0.0:1782229016.202026:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309528832 00000100:00100000:0.0:1782229016.202096:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 74 00000100:00100000:0.0:1782229016.202107:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10455:x1868802309528832:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229016.202137:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229016.202165:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63cb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497ea expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.202212:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.202241:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.202255:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.202378:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e63cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.202400:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.202409:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229016.202412:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782229016.202416:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22400, rc 0) 00000100:00100000:0.0:1782229016.202536:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10455:x1868802309528832:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 430us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229016.202545:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 74 00000100:00100000:0.0:1782229016.210699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.210801:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309529088 00000100:00100000:1.0:1782229016.210815:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309529088 00000100:00100000:1.0:1782229016.210891:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 75 00000100:00100000:1.0:1782229016.210904:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10455:x1868802309529088:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782229016.211048:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.211070:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.211085:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782229016.211530:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1782229016.211547:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329208115771ns, next at 330208111598ns, rc = 0 00000004:00010000:1.0:1782229016.211676:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e7f2d23 reply state 0000000044f96f59 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.211690:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782229016.212140:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10455:x1868802309529088:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 1234us (1454us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1782229016.212160:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 75 00010000:00010000:2.0:1782229016.214537:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.214558:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.214565:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.214573:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.214579:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.214588:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.214609:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229016.214612:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782229016.214619:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.214625:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63cbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.216327:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.216541:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309529216 00000100:00100000:3.0:1782229016.216553:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309529216 00000100:00100000:3.0:1782229016.216641:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 76 00000100:00100000:3.0:1782229016.216653:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10455:x1868802309529216:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782229016.216687:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229016.216759:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497f1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.216933:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.216949:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.216981:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:3.0:1782229016.216984:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782229016.216988:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916c00, rc 0) 00000100:00100000:3.0:1782229016.217096:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10455:x1868802309529216:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 444us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229016.217104:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 76 00000100:00100000:3.0:1782229016.222092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.222200:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309529344 00000100:00100000:1.0:1782229016.222213:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309529344 00000100:00100000:1.0:1782229016.222263:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:1.0:1782229016.222273:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2369:x1868802309529344:12345-192.168.204.22@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1782229016.222315:0:8488:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:1.0:1782229016.222363:0:8488:0:(genops.c:1406:class_connect()) connect: client 2d74cab1-6977-468d-a933-6ac020ef49f3, cookie 0x8e1c8a3488e63ccd 00002000:00100000:1.0:1782229016.222378:0:8488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2d74cab1-6977-468d-a933-6ac020ef49f3/ffff98fe7b8d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782229016.222393:0:8488:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782229016.222724:0:8488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782229016.222777:0:8488:0:(import.c:65:import_set_state_nolock()) ffff98fe74515000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782229016.222853:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2369:x1868802309529344:12345-192.168.204.22@tcp:8:lhsmtool_posix.0 Request processed in 581us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.222860:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:2.0:1782229016.225343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.225387:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309529472 00000100:00100000:1.0:1782229016.225398:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309529472 00000100:00100000:1.0:1782229016.225560:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:1.0:1782229016.225571:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:0:x1868802309529472:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1782229016.225588:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1782229016.275254:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1782229016.275276:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000100:00100000:2.0:1782229016.275407:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:0:x1868802309529472:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 49829us (50064us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782229016.275422:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:3.0:1782229016.279262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.279349:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309529728 00000100:00100000:1.0:1782229016.279361:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309529728 00000100:00100000:1.0:1782229016.279454:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:1.0:1782229016.279465:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10455:x1868802309529728:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782229016.279740:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10455:x1868802309529728:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 275us (490us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1782229016.279759:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:0.0:1782229016.285673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.285895:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309529984 00000100:00100000:1.0:1782229016.285907:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309529984 00000100:00100000:1.0:1782229016.286043:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 77 00000100:00100000:1.0:1782229016.286057:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10455:x1868802309529984:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782229016.286238:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10455:x1868802309529984:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 185us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.286247:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 77 00000100:00100000:2.0:1782229016.289877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.290079:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309530112 00000100:00100000:0.0:1782229016.290091:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309530112 00000100:00100000:0.0:1782229016.290278:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 78 00000100:00100000:0.0:1782229016.290290:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10455:x1868802309530112:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229016.290315:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229016.290354:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63cd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497f8 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.291332:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.291353:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.291368:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229016.291419:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229016.291469:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.291626:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63cd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f8 expref: 59 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.291644:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63cdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f8 expref: 58 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.291653:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229016.291657:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782229016.291661:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc000, rc 0) 00000100:00100000:2.0:1782229016.291750:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+58:10455:x1868802309530112:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 1461us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.291760:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 78 00000100:00100000:3.0:1782229016.294133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.295236:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309530240 00000100:00100000:2.0:1782229016.295250:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309530240 00000100:00100000:2.0:1782229016.295315:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:2.0:1782229016.295326:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2371:x1868802309530240:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229016.295359:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229016.295389:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99497ff expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229016.295423:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3aa818, blocks: 0x1 00010000:00010000:2.0:1782229016.295461:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1782229016.295467:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229016.295478:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 6 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.295515:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 6 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.295532:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd400, rc 0) 00000100:00100000:2.0:1782229016.295603:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2371:x1868802309530240:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 278us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.295610:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:0.0:1782229016.300423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.300661:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309530496 00000100:00100000:3.0:1782229016.300675:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309530496 00000100:00100000:3.0:1782229016.300777:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 79 00000100:00100000:3.0:1782229016.300789:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+58:10455:x1868802309530496:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782229016.300940:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+58:10455:x1868802309530496:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 151us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229016.300949:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 79 00000100:00100000:0.0:1782229016.318737:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.319282:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309530624 00000100:00100000:3.0:1782229016.319295:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309530624 00000100:00100000:3.0:1782229016.319368:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:3.0:1782229016.319397:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:10455:x1868802309530624:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782229016.319423:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229016.319474:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949806 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.319515:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 7 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.319524:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229016.319529:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229016.319536:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.319579:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 7 pid: 8488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.319598:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 7 pid: 8488 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229016.319614:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1868802329475968:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229016.319723:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782229016.322648:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1868802329475968:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229016.322693:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.322735:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916000, rc 0) 00000100:00100000:3.0:1782229016.322799:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:10455:x1868802309530624:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 3403us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229016.322809:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:1.0:1782229016.324530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.327680:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309530752 00000100:00100000:2.0:1782229016.327699:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309530752 00010000:00010000:2.0:1782229016.327764:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 7 pid: 8488 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.327821:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:2.0:1782229016.327832:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309530752:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229016.327852:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229016.327889:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 7 pid: 8488 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.327908:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 7 pid: 8488 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.327943:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63ce2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ff expref: 7 pid: 8488 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.327961:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229016.327966:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229016.327985:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.327996:0:11530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.328042:0:11530:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.328059:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11530:1868802329476096:192.168.204.22@tcp:105: 00000100:00100000:2.0:1782229016.329296:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782229016.334542:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.334613:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11530:1868802329476096:192.168.204.22@tcp:105: 00010000:00010000:2.0:1782229016.334650:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229016.334652:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309530880 00000100:00100000:3.0:1782229016.334662:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309530880 00002000:00100000:3.0:1782229016.334734:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98fe7bf11f80 x1868802309530880/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:187/0 lens 504/0 e 0 to 0 dl 1782229027 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1782229016.334736:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309530752:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6904us (10211us total) trans 0 rc 0/0 00002000:00100000:3.0:1782229016.334752:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe7bf11f80 with x1868802309530880 ext(0->8) 00002000:00010000:3.0:1782229016.334760:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe7bf11f80 00000100:00100000:2.0:1782229016.334769:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:3.0:1782229016.336193:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:3.0:1782229016.336213:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309530880:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782229016.345053:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2372:x1868802309530880:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 Request processed in 8838us (10512us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782229016.345088:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00002000:00100000:2.0:1782229016.345101:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98fe7bf11f80 x1868802309530880/t4294967302(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:187/0 lens 504/448 e 0 to 0 dl 1782229027 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229016.345114:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe7bf11f80 with x1868802309530880 ext(0->8) 00002000:00010000:2.0:1782229016.345122:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe7bf11f80 00000100:00100000:1.0:1782229016.352637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.353456:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309531008 00000100:00100000:3.0:1782229016.353471:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309531008 00000100:00100000:3.0:1782229016.353819:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 80 00000100:00100000:3.0:1782229016.353834:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+58:10455:x1868802309531008:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782229016.413689:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:3.0:1782229016.413746:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1782229016.413768:0:5818:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe452ae300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1782229016.413774:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe6e995700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe452aed80 00000020:00080000:3.0:1782229016.413778:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe6e995e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fe77cd2000 00000001:00080000:3.0:1782229016.413804:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1782229016.413812:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1782229016.413892:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1782229016.414035:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10455:x1868802309531008:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 Request processed in 60197us (61404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.414049:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 80 00000100:00100000:3.0:1782229016.414074:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782229016.414096:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329476224:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1782229016.414585:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1782229016.414751:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1782229016.415054:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229016.415113:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329476224 00000100:00100000:2.0:1782229016.415125:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329476224 00000100:00080000:3.0:1782229016.415167:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782229016.415220:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782229016.415232:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329476224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782229016.415271:0:8488:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1782229016.415319:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a3aa816, atime: 0x6a3aa816, ctime: 0x6a3aa816, blocks: 0xb 00010000:00010000:2.0:1782229016.415329:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.415349:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1782229016.415353:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229016.415361:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.415403:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.415415:0:8488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.415779:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782229016.415796:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329476352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782229016.415853:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782229016.416064:0:8488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.416104:0:8488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229016.416158:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229016.416167:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.416178:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229016.416184:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.416196:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.416219:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.416228:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e63cf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.416252:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229016.416255:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229016.416257:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229016.416265:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329476352 00000100:00100000:0.0:1782229016.416271:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329476352 00000100:00100000:0.0:1782229016.416317:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782229016.416326:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329476352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1782229016.416861:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782229016.416866:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782229016 00002000:00010000:1.0:1782229016.416869:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782229016.416871:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782229016 -> 1782229016 00002000:00010000:1.0:1782229016.416873:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782229016.416990:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329476352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 664us (1134us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782229016.416999:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1782229016.417073:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe7bf12a00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1782229016.417081:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329476352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782229016.418608:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1868802329476224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3374us (3550us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782229016.418620:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1782229016.419944:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe77b91180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1782229016.419960:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329476224:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782229016.420275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.420385:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309531136 00000100:00100000:3.0:1782229016.420411:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309531136 00000100:00100000:3.0:1782229016.420953:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:3.0:1782229016.420966:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309531136:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1782229016.475161:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1782229016.475183:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1782229016.475370:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309531136:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 Request processed in 54397us (55089us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.475384:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:1.0:1782229016.478871:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.479139:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309531392 00000100:00100000:3.0:1782229016.479151:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309531392 00000100:00100000:3.0:1782229016.479230:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00100000:3.0:1782229016.479244:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10455:x1868802309531392:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782229016.479314:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229016.479351:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63cdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f8 expref: 13 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.479374:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:3.0:1782229016.479379:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229016.479416:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.479457:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.479468:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782229016.479782:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c746ebef reply state 00000000488f0a88 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229016.479795:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782229016.479925:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+14:10455:x1868802309531392:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 683us (1067us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1782229016.479933:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 81 00010000:00010000:0.0:1782229016.482086:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.482104:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.482121:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.482127:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229016.482132:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.482141:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.482358:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229016.482363:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229016.482368:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.482376:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e63cf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.491686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.491999:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309531520 00000100:00100000:1.0:1782229016.492014:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309531520 00000100:00100000:1.0:1782229016.492104:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 31 00000100:00100000:1.0:1782229016.492126:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309531520:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782229016.492616:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1782229016.492620:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782229016 -> 1782229015 00002000:00010000:1.0:1782229016.492623:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782229014 00002000:00010000:1.0:1782229016.492626:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782229016 -> 1782229015 00002000:00010000:1.0:1782229016.492628:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782229016.492709:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309531520:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 595us (1033us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782229016.492719:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 31 00000100:00100000:0.0:1782229016.494865:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.496158:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309531776 00000100:00100000:3.0:1782229016.496181:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309531776 00000100:00100000:3.0:1782229016.496252:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 82 00000100:00100000:3.0:1782229016.496263:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10455:x1868802309531776:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782229016.496352:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.496374:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.496385:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.496447:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.496467:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 13 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229016.496486:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329476480:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229016.496595:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4465cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782229016.498819:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b92680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329476480:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229016.498856:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.504660:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.504783:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309531904 00000100:00100000:3.0:1782229016.504797:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309531904 00010000:00010000:3.0:1782229016.504855:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 14 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229016.504898:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:3.0:1782229016.504910:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:2372:x1868802309531904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229016.504940:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229016.504948:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 14 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.504977:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 14 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.505006:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e63cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497ea expref: 14 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.505022:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:3.0:1782229016.505028:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.505039:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.505048:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.505074:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229016.505140:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2372:x1868802309531904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 232us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229016.505148:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 43 00010000:00010000:1.0:1782229016.505489:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505499:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505536:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505543:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505550:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505569:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229016.505575:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505584:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505594:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:1.0:1782229016.505597:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782229016.505601:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.505607:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e63cfe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.505667:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+12:10455:x1868802309531776:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 Request processed in 9405us (10808us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782229016.505676:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 82 00000100:00100000:1.0:1782229016.522659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.522756:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309532032 00000100:00100000:0.0:1782229016.522770:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309532032 00000100:00100000:0.0:1782229016.522869:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:0.0:1782229016.522881:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309532032:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782229016.522938:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.522963:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.522985:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229016.522991:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782229016.522996:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.523039:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.523073:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 7 pid: 6598 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.523091:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1868802329476608:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229016.523212:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe47c686c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229016.526735:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1868802329476608:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229016.526774:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.530875:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.530923:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309532160 00000100:00100000:1.0:1782229016.530934:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309532160 00010000:00010000:1.0:1782229016.530992:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 8 pid: 6598 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.531053:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:1.0:1782229016.531064:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309532160:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229016.531084:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229016.531111:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 8 pid: 6598 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.531131:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 8 pid: 6598 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.531161:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efd1af76/0x8e1c8a3488e63ce9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949806 expref: 8 pid: 6598 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.531178:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229016.531182:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229016.531189:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.531200:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.531280:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229016.531346:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309532160:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 284us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.531355:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 44 00010000:00010000:0.0:1782229016.537694:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537720:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537766:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537776:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537785:0:6598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537793:0:6598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22e00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229016.537799:0:6598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537824:0:6598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537848:0:6598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.537857:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63d05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.538003:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309532032:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 Request processed in 15117us (15352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229016.538016:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:3.0:1782229016.543849:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.543894:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309532416 00000100:00100000:3.0:1782229016.543904:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309532416 00000100:00100000:3.0:1782229016.543986:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 83 00000100:00100000:3.0:1782229016.543999:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+12:10455:x1868802309532416:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782229016.544123:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.544145:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.544159:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.544455:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.544468:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.544477:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.544539:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.544559:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 13 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229016.544576:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329476736:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229016.544680:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41ca1780 going to sleep for 11 seconds 00000100:00100000:1.0:1782229016.557588:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.557698:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309532544 00000100:00100000:0.0:1782229016.557710:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309532544 00010000:00010000:0.0:1782229016.557762:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 14 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.557809:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:0.0:1782229016.557820:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:2372:x1868802309532544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229016.557838:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229016.557845:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 14 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.557863:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 14 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.557904:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229016.557911:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.557922:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.557930:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.557952:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229016.558033:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:2372:x1868802309532544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 213us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229016.558041:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 45 00010000:00010000:3.0:1782229016.558908:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63cc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497f1 expref: 13 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229016.558937:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329476736:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229016.558988:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.559000:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.559006:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782229016.559317:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1782229016.559531:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1782229016.559580:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1782229016.559693:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329476864:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782229016.559763:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229016.559918:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5a391780 going to sleep for 11 seconds 00000100:00100000:1.0:1782229016.561734:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329476864 00000100:00100000:1.0:1782229016.561748:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329476864 00000100:00100000:1.0:1782229016.561815:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782229016.561827:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1868802329476864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782229016.563298:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1868802329476864:12345-0@lo:1000:mdt00_002.0 Request processed in 1464us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.563311:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782229016.573105:0:5798:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1782229016.573123:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe7bf12a00, transno 4294967303 00000100:00100000:3.0:1782229016.573150:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329476864:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1782229016.573790:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1782229016.573894:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329476992:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782229016.574065:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229016.574101:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782229016.574264:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329476992 00000100:00100000:0.0:1782229016.574274:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329476992 00000100:00100000:0.0:1782229016.574337:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782229016.574348:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1868802329476992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782229016.574612:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1868802329476992:12345-0@lo:1000:mdt00_002.0 Request processed in 265us (547us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782229016.574621:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782229016.574669:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329476992:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1782229016.574711:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574723:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574746:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574752:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229016.574758:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574767:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574789:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229016.574793:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229016.574798:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574805:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e63d13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574852:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574858:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574863:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574869:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229016.574872:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574886:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574895:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd000) 00010000:00010000:0.0:1782229016.574898:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229016.574900:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574906:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63c41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574930:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574947:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 16 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574956:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.574997:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 16 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.575017:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 16 pid: 10359 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.575031:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329477120:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229016.575108:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe47c68480 going to sleep for 11 seconds 00000100:00100000:1.0:1782229016.594526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229016.594570:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309532672 00000100:00100000:1.0:1782229016.594582:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309532672 00010000:00010000:1.0:1782229016.594632:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 17 pid: 10359 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.594674:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:1.0:1782229016.594685:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+17:2372:x1868802309532672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229016.594704:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229016.594712:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 17 pid: 10359 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.594731:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 17 pid: 10359 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.594759:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd000) 00010000:00010000:1.0:1782229016.594765:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.594777:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.594793:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.594819:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229016.594884:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+17:2372:x1868802309532672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 200us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229016.594892:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 46 00010000:00010000:0.0:1782229016.595313:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e63c5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99497d5 expref: 16 pid: 10359 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.595340:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329477120:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229016.595365:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595374:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595380:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595395:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595402:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595408:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595414:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229016.595418:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595426:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595453:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd000) 00010000:00010000:0.0:1782229016.595456:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229016.595460:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595476:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63d1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595487:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595493:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595499:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595503:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229016.595505:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595511:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595519:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd000) 00010000:00010000:0.0:1782229016.595521:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782229016.595523:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.595528:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63d0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.595811:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+15:10455:x1868802309532416:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 51814us (51975us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1782229016.595821:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 83 00000020:00080000:0.0:1782229016.595832:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782229016.595979:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782229016.595984:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782229016.596035:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782229016.596042:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229016.604007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.607295:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309532928 00000100:00100000:3.0:1782229016.607312:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309532928 00000100:00100000:3.0:1782229016.607402:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:3.0:1782229016.607415:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+15:10455:x1868802309532928:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782229016.608369:0:5800:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782229016.608532:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1782229016.608597:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.608618:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.608632:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.608642:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.608650:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.608657:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229016.608689:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782229016.608808:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+17:10455:x1868802309532928:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 1392us (4814us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1782229016.608818:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 20 00000020:00080000:3.0:1782229016.608824:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782229016.609085:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229016.609094:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.609103:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229016.609108:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.609117:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.609132:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229016.609136:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782229016.609141:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.609148:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63d21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229016.609230:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229016.609233:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229016.609235:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782229016.647833:0:11868:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782229016.647851:0:11868:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782229016.647898:0:11868:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782229016.647904:0:11868:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782229016.783390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.787340:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309533184 00000100:00100000:2.0:1782229016.787361:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309533184 00000100:00100000:2.0:1782229016.787455:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 84 00000100:00100000:2.0:1782229016.787467:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+17:10465:x1868802309533184:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229016.787508:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229016.787534:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994980d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.787840:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63d2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.787858:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63d2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.787871:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63d2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229016.787883:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782229016.788086:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994980d expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.788102:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63d2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994980d expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.788113:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229016.788117:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782229016.788121:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd800, rc 0) 00000100:00100000:2.0:1782229016.788235:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+19:10465:x1868802309533184:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 770us (4857us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1782229016.788243:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 84 00000100:00100000:1.0:1782229016.792084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.792185:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309533312 00000100:00100000:2.0:1782229016.792197:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309533312 00000100:00100000:2.0:1782229016.792277:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00100000:2.0:1782229016.792296:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+19:10465:x1868802309533312:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:2.0:1782229016.792398:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792420:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792462:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792481:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792489:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792496:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792845:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792855:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792863:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782229016.792909:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792923:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792935:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792943:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792950:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.792955:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792972:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.792986:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229016.792989:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229016.792993:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793000:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793013:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793018:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793025:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793031:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.793038:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793045:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793051:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe58ddd300) 00010000:00010000:2.0:1782229016.793053:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229016.793056:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793061:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793074:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793079:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793086:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793091:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcda00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.793094:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793099:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793105:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58dddd00) 00010000:00010000:2.0:1782229016.793107:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229016.793113:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.793119:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.793207:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+19:10465:x1868802309533312:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 913us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.793215:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00100000:0.0:1782229016.848305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.848453:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309533568 00000100:00100000:2.0:1782229016.848467:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309533568 00000100:00100000:2.0:1782229016.848541:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 86 00000100:00100000:2.0:1782229016.848554:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+19:10468:x1868802309533568:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229016.848580:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229016.848605:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949814 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.848697:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.848713:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.848725:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.848741:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.848748:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.848768:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849142:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849150:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849157:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229016.849168:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782229016.849272:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849280:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849287:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849294:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.849299:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849307:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849321:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229016.849324:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229016.849335:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849341:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63d59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849354:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849360:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849365:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849370:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.849373:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849378:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849385:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe58dddd00) 00010000:00010000:2.0:1782229016.849388:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229016.849391:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849396:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63d60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849471:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 22 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849498:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.849506:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:2.0:1782229016.849509:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229016.849511:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc600, rc 0) 00000100:00100000:2.0:1782229016.849592:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+21:10468:x1868802309533568:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1041us (1300us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1782229016.849600:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 86 00000100:00100000:1.0:1782229016.872318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.872471:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309533696 00000100:00100000:2.0:1782229016.872485:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309533696 00000100:00100000:2.0:1782229016.872562:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 87 00000100:00100000:2.0:1782229016.872575:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+21:10468:x1868802309533696:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:2.0:1782229016.872666:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872687:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872702:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872735:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872743:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872771:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872778:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.872783:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872791:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872807:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:2.0:1782229016.872810:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229016.872815:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.872822:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.872916:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+21:10468:x1868802309533696:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 344us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229016.872924:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 87 00000100:00100000:1.0:1782229016.878110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229016.878237:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309533952 00000100:00100000:3.0:1782229016.878250:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309533952 00000100:00100000:3.0:1782229016.878366:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00100000:3.0:1782229016.878379:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+21:10468:x1868802309533952:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229016.879061:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+22:10468:x1868802309533952:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 681us (965us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1782229016.879073:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 21 00010000:00010000:0.0:1782229016.955734:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229016.956969:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.957135:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309534208 00000100:00100000:2.0:1782229016.957148:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309534208 00000100:00100000:2.0:1782229016.957232:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 88 00000100:00100000:2.0:1782229016.957243:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:9997:x1868802309534208:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229016.957273:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229016.957298:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994981b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.957487:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.957505:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.957514:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.957553:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.957570:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 23 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.957586:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329477248:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229016.957695:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229016.964270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.964518:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309534336 00000100:00100000:0.0:1782229016.964530:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309534336 00010000:00010000:0.0:1782229016.964601:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 24 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229016.964654:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:0.0:1782229016.964667:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2373:x1868802309534336:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229016.964687:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229016.964695:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 24 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.964716:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 24 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.964746:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:0.0:1782229016.964753:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.964766:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.964796:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.964823:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229016.964919:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2373:x1868802309534336:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 253us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229016.964929:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 47 00010000:00010000:2.0:1782229016.965390:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949814 expref: 23 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.965411:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329477248:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229016.965502:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.965515:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.966298:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229016.966325:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782229016.967716:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.967746:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.967757:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:2.0:1782229016.967761:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782229016.967764:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcda00, rc 0) 00000100:00100000:2.0:1782229016.967985:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+23:9997:x1868802309534208:12345-192.168.204.22@tcp:101:bash.0 Request processed in 10743us (11036us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1782229016.967996:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 88 00000100:00100000:1.0:1782229016.981175:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229016.985069:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309534592 00000100:00100000:2.0:1782229016.985092:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309534592 00000100:00100000:2.0:1782229016.985203:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 89 00000100:00100000:2.0:1782229016.985216:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+23:9997:x1868802309534592:12345-192.168.204.22@tcp:36:bash.0 00010000:00010000:2.0:1782229016.985630:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.985651:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.985664:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782229016.985752:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1782229016.985780:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d3e27a7 reply state 00000000cf97eaa1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229016.985790:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1782229016.985842:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1782229016.986016:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+27:9997:x1868802309534592:12345-192.168.204.22@tcp:36:bash.0 Request processed in 800us (4851us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1782229016.986025:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 89 00000020:00080000:2.0:1782229016.986031:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1782229016.987874:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.987896:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.987905:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.987919:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229016.987925:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.987935:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.987954:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:2.0:1782229016.987967:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229016.987974:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229016.988008:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63d91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229016.991410:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.991549:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309534720 00000100:00100000:0.0:1782229016.991561:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309534720 00000100:00100000:0.0:1782229016.991678:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 90 00000100:00100000:0.0:1782229016.991691:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+26:9997:x1868802309534720:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229016.991725:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229016.991751:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63d98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949822 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.991826:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949822 expref: 27 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.991844:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949822 expref: 27 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.991869:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:0.0:1782229016.991873:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229016.991877:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23c00, rc 0) 00000100:00100000:0.0:1782229016.991954:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+27:9997:x1868802309534720:12345-192.168.204.22@tcp:101:bash.0 Request processed in 265us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229016.991973:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 90 00000100:00100000:1.0:1782229016.994824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.994923:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309534848 00000100:00100000:0.0:1782229016.994935:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309534848 00000100:00100000:0.0:1782229016.995020:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:0.0:1782229016.995033:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:9997:x1868802309534848:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229016.995059:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229016.995087:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949829 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782229016.995122:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3aa817, atime: 0x6a3aa816, ctime: 0x6a3aa817, blocks: 0xb 00010000:00010000:0.0:1782229016.995150:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1782229016.995156:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229016.995179:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 7 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.995199:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 7 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229016.995217:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23200, rc 0) 00000100:00100000:0.0:1782229016.995297:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:9997:x1868802309534848:12345-192.168.204.22@tcp:101:bash.0 Request processed in 267us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229016.995306:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:3.0:1782229016.997924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229016.998090:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309534976 00000100:00100000:0.0:1782229016.998114:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309534976 00002000:00010000:0.0:1782229016.998181:0:6603:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782229016.998188:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fd425c8700 with x1868802309534976 ext(0->18446744073709551615) 00002000:00010000:0.0:1782229016.998202:0:6603:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fd425c8700. 00000100:00100000:0.0:1782229016.998241:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:0.0:1782229016.998260:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2371:x1868802309534976:12345-192.168.204.22@tcp:10:bash.0 00002000:00010000:0.0:1782229016.998686:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1782229016.998691:0:6603:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782229015 -> 1782229017 00002000:00010000:0.0:1782229016.998694:0:6603:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1782229014 -> 1782229014 00002000:00010000:0.0:1782229016.998696:0:6603:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782229015 -> 1782229017 00002000:00010000:0.0:1782229016.998698:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1782229016.998771:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2371:x1868802309534976:12345-192.168.204.22@tcp:10:bash.0 Request processed in 511us (863us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782229016.998778:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1 00002000:00010000:0.0:1782229016.998782:0:6603:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782229016.998785:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fd425c8700 with x1868802309534976 ext(0->18446744073709551615) 00002000:00010000:0.0:1782229016.998790:0:6603:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fd425c8700. 00000100:00100000:2.0:1782229017.085766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229017.085871:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309535104 00000100:00100000:3.0:1782229017.085885:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309535104 00000100:00100000:3.0:1782229017.085983:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 91 00000100:00100000:3.0:1782229017.085998:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+27:10482:x1868802309535104:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:3.0:1782229017.086095:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086117:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086132:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086148:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086165:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086173:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086623:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086634:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086641:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782229017.086693:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086717:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086725:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086732:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086738:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.086743:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086750:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086766:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:3.0:1782229017.086768:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229017.086774:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086780:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63da6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086792:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086797:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086802:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086812:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.086816:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086822:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086830:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe43933f00) 00010000:00010000:3.0:1782229017.086833:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229017.086835:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086842:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63dad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086859:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086866:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086872:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086877:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.086881:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086887:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086907:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:3.0:1782229017.086909:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229017.086912:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.086919:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229017.087030:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+27:10482:x1868802309535104:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 1034us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229017.087038:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 91 00000100:00080000:2.0:1782229017.087829:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229017.127134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.127376:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309535360 00000100:00100000:2.0:1782229017.127391:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309535360 00000100:00100000:2.0:1782229017.127524:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 92 00000100:00100000:2.0:1782229017.127536:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+27:10485:x1868802309535360:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229017.127569:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229017.127598:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63dbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949830 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.127699:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.127731:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.127745:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.127764:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.127773:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.127780:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128267:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63dd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128278:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128286:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229017.128299:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782229017.128461:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128471:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128479:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128485:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229017.128491:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128499:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128515:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229017.128518:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229017.128525:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128543:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63dc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128560:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128566:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128571:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128576:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229017.128580:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128586:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128595:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe58dddd00) 00010000:00010000:2.0:1782229017.128609:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229017.128613:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128620:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128674:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63dbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949830 expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128689:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949830 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.128702:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:2.0:1782229017.128718:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782229017.128721:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd600, rc 0) 00000100:00100000:2.0:1782229017.130317:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10485:x1868802309535360:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 2771us (3188us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1782229017.130332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 92 00000100:00100000:1.0:1782229017.142686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229017.142794:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309535488 00000100:00100000:3.0:1782229017.142808:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309535488 00000100:00100000:3.0:1782229017.142890:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 93 00000100:00100000:3.0:1782229017.142903:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10485:x1868802309535488:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:3.0:1782229017.143012:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.143034:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.143045:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.143092:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.143111:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 29 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229017.143149:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329477376:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229017.143305:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41ca1180 going to sleep for 11 seconds 00000100:00100000:1.0:1782229017.146605:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.146765:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309535744 00000100:00100000:2.0:1782229017.146777:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309535744 00000100:00100000:2.0:1782229017.146854:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:2.0:1782229017.146867:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+30:5583:x1868802309535744:12345-192.168.204.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782229017.147346:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+31:5583:x1868802309535744:12345-192.168.204.22@tcp:35:ldlm_bl.0 Request processed in 480us (753us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1782229017.147356:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:3.0:1782229017.148003:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329477376:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229017.148041:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229017.150895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.151169:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309535872 00000100:00100000:2.0:1782229017.151183:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309535872 00010000:00010000:2.0:1782229017.151239:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 31 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.151331:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:2.0:1782229017.151343:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+31:2373:x1868802309535872:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229017.151366:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229017.151375:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 31 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.151394:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 31 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.151484:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63d83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994981b expref: 31 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.151504:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:2.0:1782229017.151509:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.151521:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.151530:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.151620:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229017.151714:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+30:2373:x1868802309535872:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 364us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229017.151723:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 48 00010000:00010000:3.0:1782229017.153362:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153382:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153505:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153513:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153521:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153528:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.153533:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153541:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153559:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:3.0:1782229017.153583:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782229017.153590:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.153597:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63dde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229017.153849:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10485:x1868802309535488:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 10943us (11175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229017.153861:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 93 00000100:00100000:1.0:1782229017.161051:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.161192:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309536128 00000100:00100000:2.0:1782229017.161205:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309536128 00000100:00100000:2.0:1782229017.161283:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:2.0:1782229017.161295:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+29:10485:x1868802309536128:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:2.0:1782229017.161653:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+30:10485:x1868802309536128:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 358us (614us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1782229017.161662:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:0.0:1782229017.262169:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229017.262622:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309536384 00000100:00100000:1.0:1782229017.262637:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309536384 00000100:00100000:1.0:1782229017.262913:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 94 00000100:00100000:1.0:1782229017.262928:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+30:10496:x1868802309536384:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:1.0:1782229017.262975:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229017.263004:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63de5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949837 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263117:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263137:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263151:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263179:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263215:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263223:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263833:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63dfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263846:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.263855:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229017.263868:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1782229017.264007:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264015:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264022:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264029:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229017.264034:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264041:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264066:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:1.0:1782229017.264069:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229017.264075:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264081:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63dec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264095:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264102:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264109:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264113:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229017.264116:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264123:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264131:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe439ad000) 00010000:00010000:1.0:1782229017.264133:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229017.264136:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264142:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63df3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264663:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63de5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949837 expref: 33 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264684:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63dfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949837 expref: 32 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.264692:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:1.0:1782229017.264694:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229017.264697:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420000, rc 0) 00000100:00100000:1.0:1782229017.264884:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+32:10496:x1868802309536384:12345-192.168.204.22@tcp:101:cat.0 Request processed in 1959us (2741us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1782229017.264894:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 94 00000100:00100000:0.0:1782229017.270745:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.270860:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309536640 00000100:00100000:2.0:1782229017.270873:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309536640 00000100:00100000:2.0:1782229017.270965:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:2.0:1782229017.271002:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+32:10496:x1868802309536640:12345-192.168.204.22@tcp:35:cat.0 00000100:00100000:2.0:1782229017.271365:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+33:10496:x1868802309536640:12345-192.168.204.22@tcp:35:cat.0 Request processed in 365us (635us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1782229017.271373:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:0.0:1782229017.295217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.295383:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309536896 00000100:00100000:2.0:1782229017.295398:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309536896 00000100:00100000:2.0:1782229017.295521:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 95 00000100:00100000:2.0:1782229017.295533:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+33:10497:x1868802309536896:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:2.0:1782229017.295637:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782229017.295673:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63dfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949837 expref: 33 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295701:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63dd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949830 expref: 32 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295714:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63d98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949822 expref: 31 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295725:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58ddd300) 00010000:00010000:2.0:1782229017.295739:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229017.295766:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295784:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295795:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295825:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295833:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.295841:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.296585:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.296597:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.296605:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229017.298555:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1782229017.298573:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330295141503ns, next at 331295137325ns, rc = 0 00010000:00010000:2.0:1782229017.298673:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298690:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298700:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298725:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298750:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298756:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298783:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229017.298814:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298821:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298828:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298835:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229017.298840:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298850:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298867:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58dddf00) 00010000:00010000:2.0:1782229017.298870:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782229017.298876:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298883:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298906:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298918:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298924:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298929:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcda00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229017.298933:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298939:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298949:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229017.298963:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229017.298967:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.298973:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782229017.298985:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036ff356e reply state 00000000265e65f4 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.298997:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782229017.299131:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+32:10497:x1868802309536896:12345-192.168.204.22@tcp:36:rm.0 Request processed in 3595us (3931us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1782229017.299142:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 95 00010000:00010000:3.0:1782229017.299731:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229017.299741:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.299748:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229017.299752:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.299759:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.299770:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98fe58dddf00) 00010000:00010000:3.0:1782229017.299772:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782229017.299775:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.299781:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63e1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.299800:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229017.299803:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229017.299804:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229017.305678:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.305704:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.305712:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.305719:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.305725:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.305735:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.305757:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe58dddd00) 00010000:00010000:3.0:1782229017.305761:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229017.305766:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.305773:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e63e0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.353940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.354242:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309537152 00000100:00100000:2.0:1782229017.354256:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309537152 00000100:00100000:2.0:1782229017.354355:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 96 00000100:00100000:2.0:1782229017.354367:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+31:10503:x1868802309537152:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229017.354401:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229017.354491:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994983e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.354671:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.354689:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.354702:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.354717:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.354724:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.354730:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782229017.355422:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1782229017.355683:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355696:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355705:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355759:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355768:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355776:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355782:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229017.355787:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355795:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355808:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229017.355812:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229017.355817:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355822:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782229017.355836:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ab2c342 reply state 000000007b6d78b3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.355847:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782229017.355884:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355912:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.355919:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:2.0:1782229017.355922:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229017.355924:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dccc00, rc 0) 00000100:00100000:2.0:1782229017.356037:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+34:10503:x1868802309537152:12345-192.168.204.22@tcp:101:bash.0 Request processed in 1672us (2113us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1782229017.356047:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 96 00010000:00010000:2.0:1782229017.358948:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.358981:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.358989:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.358997:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229017.359002:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.359011:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.359032:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe58ddd300) 00010000:00010000:2.0:1782229017.359036:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229017.359042:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.359067:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63e32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.364140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.364319:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309537280 00000100:00100000:2.0:1782229017.364333:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309537280 00000100:00100000:2.0:1782229017.364460:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:2.0:1782229017.364474:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309537280:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229017.364502:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229017.364536:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949845 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229017.364574:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229017.364609:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1782229017.364615:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229017.364627:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.364651:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.364669:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcda00, rc 0) 00000100:00100000:2.0:1782229017.364772:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309537280:12345-192.168.204.22@tcp:101:bash.0 Request processed in 301us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229017.364780:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:0.0:1782229017.374030:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.374382:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309537408 00000100:00100000:2.0:1782229017.374396:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309537408 00000100:00100000:2.0:1782229017.374599:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:2.0:1782229017.374612:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:10503:x1868802309537408:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229017.374639:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229017.374664:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994984c expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.374706:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.374717:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229017.374722:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229017.374727:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 7 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.374769:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.374787:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 7 pid: 6600 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.374804:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8488:1868802329477504:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229017.374980:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b900 going to sleep for 11 seconds 00000100:00100000:1.0:1782229017.379162:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229017.379393:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309537536 00000100:00100000:0.0:1782229017.379405:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309537536 00010000:00010000:0.0:1782229017.379567:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 8 pid: 6600 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.379626:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:0.0:1782229017.379638:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309537536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229017.379660:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229017.379824:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 8 pid: 6600 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.379844:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 8 pid: 6600 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.379878:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229017.379883:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229017.379894:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.379905:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.379966:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.379984:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1868802329477632:192.168.204.22@tcp:105: 00000100:00100000:0.0:1782229017.380260:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe47c68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782229017.382800:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1868802329477632:192.168.204.22@tcp:105: 00010000:00010000:3.0:1782229017.382834:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229017.382902:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309537536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 3265us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229017.382915:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 49 00010000:00010000:2.0:1782229017.384121:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074e5af4a/0x8e1c8a3488e63e47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949845 expref: 7 pid: 6600 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.384145:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8488:1868802329477504:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229017.384340:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.384359:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd600, rc 0) 00000100:00100000:2.0:1782229017.384545:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:10503:x1868802309537408:12345-192.168.204.22@tcp:101:bash.0 Request processed in 9935us (10530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229017.384553:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:0.0:1782229017.388540:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.388640:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309537792 00000100:00100000:2.0:1782229017.388653:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309537792 00000100:00100000:2.0:1782229017.388727:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:2.0:1782229017.388738:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+33:10503:x1868802309537792:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:2.0:1782229017.389216:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+34:10503:x1868802309537792:12345-192.168.204.22@tcp:35:bash.0 Request processed in 478us (688us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1782229017.389225:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:3.0:1782229017.570756:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229017.571131:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309537920 00000100:00100000:0.0:1782229017.571145:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309537920 00000100:00100000:0.0:1782229017.571228:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 97 00000100:00100000:0.0:1782229017.571241:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+34:10519:x1868802309537920:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229017.571273:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229017.571300:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949853 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.571413:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63e5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.571480:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.571495:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229017.571577:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782229017.571586:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229017.571615:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.571646:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e63e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949853 expref: 36 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.571666:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949853 expref: 35 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.571675:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229017.571678:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229017.571682:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23600, rc 0) 00000100:00100000:0.0:1782229017.571960:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+35:10519:x1868802309537920:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 711us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229017.571968:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 97 00000100:00100000:1.0:1782229017.576571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229017.576748:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309538176 00000100:00100000:0.0:1782229017.576762:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309538176 00000100:00100000:0.0:1782229017.576865:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 98 00000100:00100000:0.0:1782229017.576878:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+35:10519:x1868802309538176:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229017.576907:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229017.576937:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63e63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994985a expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.577109:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63e6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.577127:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.577141:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229017.577167:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782229017.577355:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e63e63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994985a expref: 38 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.577380:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63e6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994985a expref: 37 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.577391:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:0.0:1782229017.577395:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229017.577400:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23c00, rc 0) 00000100:00100000:0.0:1782229017.578080:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+37:10519:x1868802309538176:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1196us (1515us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1782229017.578101:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 98 00000100:00100000:3.0:1782229017.582849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229017.583198:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.583300:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309538560 00000100:00100000:2.0:1782229017.583314:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309538560 00000100:00100000:2.0:1782229017.583394:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 99 00000100:00100000:2.0:1782229017.583405:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+37:10519:x1868802309538560:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229017.583473:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229017.583502:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949861 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.583637:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.583664:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.583688:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229017.583705:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782229017.583867:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63e78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949861 expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.583889:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949861 expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.583899:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:2.0:1782229017.583902:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782229017.583905:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd400, rc 0) 00000100:00100000:2.0:1782229017.583994:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+39:10519:x1868802309538560:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 584us (791us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1782229017.584003:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 99 00000100:00100000:0.0:1782229017.589247:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309538304 00000100:00100000:0.0:1782229017.589292:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309538304 00000100:00100000:0.0:1782229017.589447:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:0.0:1782229017.589461:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+39:2371:x1868802309538304:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229017.589484:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229017.589520:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e63e6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994985a expref: 39 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.589544:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:0.0:1782229017.589550:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229017.589627:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+38:2371:x1868802309538304:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 169us (6793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229017.589635:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:3.0:1782229017.592909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.593022:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309538688 00000100:00100000:2.0:1782229017.593036:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309538688 00000100:00100000:2.0:1782229017.593111:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:2.0:1782229017.593123:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309538688:12345-192.168.204.22@tcp:1:lfs.0 00010000:00010000:2.0:1782229017.593199:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.593226:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.593235:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229017.593258:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782229017.593264:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.593308:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 6 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.593327:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 6 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.593346:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6600:1868802329477760:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229017.593483:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b900 going to sleep for 11 seconds 00000100:00100000:2.0:1782229017.596765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.596813:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309538816 00000100:00100000:2.0:1782229017.596824:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309538816 00002000:00100000:2.0:1782229017.596894:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98fe50dc0e00 x1868802309538816/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:188/0 lens 504/0 e 0 to 0 dl 1782229028 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229017.596907:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe50dc0e00 with x1868802309538816 ext(0->8) 00010000:00010000:2.0:1782229017.596919:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 7 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.596957:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 7 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229017.596967:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe50dc0e00 00000100:00100000:2.0:1782229017.597012:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:2.0:1782229017.597023:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309538816:12345-192.168.204.22@tcp:4:lfs.0 00000100:00100000:2.0:1782229017.597794:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2372:x1868802309538816:12345-192.168.204.22@tcp:4:lfs.0 Request processed in 767us (1041us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782229017.597806:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1 00002000:00100000:2.0:1782229017.597817:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98fe50dc0e00 x1868802309538816/t4294967302(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:188/0 lens 504/448 e 0 to 0 dl 1782229028 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229017.597827:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe50dc0e00 with x1868802309538816 ext(0->8) 00010000:00010000:2.0:1782229017.597835:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 9 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.597855:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 9 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229017.597863:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe50dc0e00 00000100:00100000:3.0:1782229017.598606:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6600:1868802329477760:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229017.598643:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.601590:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229017.601723:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309538944 00000100:00100000:3.0:1782229017.601738:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309538944 00010000:00010000:3.0:1782229017.601791:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 9 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229017.601845:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:3.0:1782229017.601859:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2370:x1868802309538944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229017.601882:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782229017.601908:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782229017.601911:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782229017 00002000:00010000:3.0:1782229017.601914:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782229017 00002000:00010000:3.0:1782229017.601916:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782229017 00010000:00010000:3.0:1782229017.601923:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 9 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.601944:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 9 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.601987:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f28eb604/0x8e1c8a3488e63e4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994984c expref: 9 pid: 8488 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.602036:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229017.602041:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229017.602048:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.602060:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.602227:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229017.602303:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2370:x1868802309538944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 446us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229017.602311:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 50 00010000:00010000:2.0:1782229017.603903:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.603925:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.603979:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.603989:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.604023:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.604031:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229017.604036:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.604048:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.604067:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.604076:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083b4abee/0x8e1c8a3488e63e8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.604321:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309538688:12345-192.168.204.22@tcp:1:lfs.0 Request processed in 11193us (11421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229017.604334:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:0.0:1782229017.608356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.609909:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309539200 00000100:00100000:2.0:1782229017.609925:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309539200 00000100:00100000:2.0:1782229017.610019:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:2.0:1782229017.610031:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+38:10519:x1868802309539200:12345-192.168.204.22@tcp:35:lfs.0 00000004:00010000:2.0:1782229017.610191:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949861 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782229017.610741:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1782229017.610790:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1782229017.611404:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1782229017.611524:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.611549:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 42 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.611560:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.611607:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 42 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.611630:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 42 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.611649:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1868802329477888:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229017.611962:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782229017.618783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229017.618896:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309539328 00000100:00100000:1.0:1782229017.618909:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309539328 00010000:00010000:1.0:1782229017.618971:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 43 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229017.619021:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:1.0:1782229017.619032:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+43:2372:x1868802309539328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229017.619051:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229017.619059:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 43 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.619077:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 43 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.619138:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:1.0:1782229017.619143:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.619160:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.619168:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.619191:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229017.619272:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+43:2372:x1868802309539328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 241us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229017.619281:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 51 00010000:00010000:3.0:1782229017.621286:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e63e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994983e expref: 42 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229017.621317:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1868802329477888:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229017.621350:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.621698:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.621803:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782229017.621987:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1782229017.622385:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1782229017.622811:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329478016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782229017.622900:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229017.623010:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b480 going to sleep for 11 seconds 00000100:00100000:0.0:1782229017.623063:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329478016 00000100:00100000:0.0:1782229017.623073:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329478016 00000100:00100000:0.0:1782229017.623329:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782229017.623343:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5799:x1868802329478016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782229017.623496:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5799:x1868802329478016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229017.623505:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782229017.623600:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329478016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782229017.624198:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1782229017.624280:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329478144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782229017.624328:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229017.625602:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229017.625791:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329478144 00000100:00100000:1.0:1782229017.625802:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329478144 00000100:00100000:1.0:1782229017.625863:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782229017.625874:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5799:x1868802329478144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782229017.626364:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5799:x1868802329478144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 490us (2033us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782229017.626374:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782229017.626642:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329478144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1782229017.626733:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1782229017.626793:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.626806:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.626837:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.626845:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.626851:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.626860:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.626881:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:3.0:1782229017.626884:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782229017.626891:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.626898:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e63e94 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782229017.627404:0:5799:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782229017.629029:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1782229017.629051:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330625620540ns, next at 331625616713ns, rc = 0 00000001:00080000:2.0:1782229017.629065:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1782229017.629277:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:2.0:1782229017.629281:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782229017.629296:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e63e7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949861 expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.630608:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+45:10519:x1868802309539200:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 20570us (22257us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1782229017.630623:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 26 00000020:00080000:2.0:1782229017.630631:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782229017.635775:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229017.638305:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309539456 00000100:00100000:1.0:1782229017.638324:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309539456 00000100:00100000:1.0:1782229017.638724:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 100 00000100:00100000:1.0:1782229017.638738:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+45:10519:x1868802309539456:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229017.638787:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229017.638833:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e63e9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949868 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.638938:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e63e9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949868 expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.638969:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e63e9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949868 expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.638993:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229017.638997:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229017.639001:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421200, rc 0) 00000100:00100000:1.0:1782229017.639098:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+46:10519:x1868802309539456:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 354us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229017.639106:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 100 00000100:00100000:0.0:1782229017.647263:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229017.647544:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309539712 00000100:00100000:3.0:1782229017.647558:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309539712 00000100:00100000:3.0:1782229017.647638:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:3.0:1782229017.647650:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+46:10519:x1868802309539712:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229017.647993:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10519:x1868802309539712:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 345us (746us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1782229017.648003:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:2.0:1782229017.745857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229017.746068:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309539840 00000100:00100000:0.0:1782229017.746082:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309539840 00000100:00100000:0.0:1782229017.746172:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 101 00000100:00100000:0.0:1782229017.746185:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10529:x1868802309539840:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:0.0:1782229017.746293:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746573:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746589:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746635:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746644:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746651:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746791:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746799:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746805:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229017.746863:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746878:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746887:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746909:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746916:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229017.746921:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746929:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746954:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229017.746958:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229017.746964:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746971:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63ea2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746987:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746993:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.746999:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747004:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229017.747007:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747021:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747030:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe42cb9f00) 00010000:00010000:0.0:1782229017.747032:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229017.747035:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747041:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e63ea9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747058:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747065:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747071:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747077:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229017.747080:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747086:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747094:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:0.0:1782229017.747096:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229017.747099:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.747115:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e63eb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.747963:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10529:x1868802309539840:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 1774us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229017.747974:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 101 00000100:00100000:0.0:1782229017.791244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229017.791470:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309540096 00000100:00100000:1.0:1782229017.791483:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309540096 00000100:00100000:1.0:1782229017.791565:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 102 00000100:00100000:1.0:1782229017.791576:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+47:10532:x1868802309540096:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229017.791608:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229017.791649:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63eb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994986f expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.791754:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.791773:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.791787:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.791824:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.791833:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.791840:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792024:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792033:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792040:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229017.792051:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782229017.792374:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792383:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792390:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792397:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229017.792403:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792423:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792477:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:1.0:1782229017.792480:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229017.792486:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792492:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63ebe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792507:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792513:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792518:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792522:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229017.792524:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792530:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792535:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe439add00) 00010000:00010000:1.0:1782229017.792538:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229017.792540:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.792554:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63ec5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.793224:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 50 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.793258:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 49 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.793267:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229017.793269:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229017.793272:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420c00, rc 0) 00000100:00100000:1.0:1782229017.793491:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+49:10532:x1868802309540096:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1914us (2260us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1782229017.793501:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 102 00000100:00100000:1.0:1782229017.810466:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229017.810880:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309540224 00000100:00100000:3.0:1782229017.810892:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309540224 00000100:00100000:3.0:1782229017.810995:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 103 00000100:00100000:3.0:1782229017.811007:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+49:10532:x1868802309540224:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:3.0:1782229017.811116:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811139:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811163:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811199:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811207:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811215:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811223:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.811228:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811237:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811252:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229017.811256:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782229017.811262:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.811281:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63eda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229017.812042:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+49:10532:x1868802309540224:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 1028us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229017.812054:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 103 00000100:00100000:2.0:1782229017.820732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229017.821022:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309540480 00000100:00100000:0.0:1782229017.821035:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309540480 00000100:00100000:0.0:1782229017.821116:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 28 00000100:00100000:0.0:1782229017.821128:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+49:10532:x1868802309540480:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229017.821580:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10532:x1868802309540480:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 452us (860us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1782229017.821589:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 28 00000100:00100000:3.0:1782229017.907413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.907889:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309540736 00000100:00100000:2.0:1782229017.907903:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309540736 00000100:00100000:2.0:1782229017.907995:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 104 00000100:00100000:2.0:1782229017.908008:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10542:x1868802309540736:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229017.908063:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229017.908067:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782229017.908105:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e63e5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949853 expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.908129:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229017.908135:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229017.908162:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63ee1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949876 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.908296:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.908314:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 50 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.908324:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.908368:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 50 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229017.908386:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 50 pid: 10359 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229017.908402:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50dc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329478272:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229017.909884:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b180 going to sleep for 11 seconds 00000100:00100000:2.0:1782229017.912044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229017.912214:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50dc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329478272:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229017.912242:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309540864 00010000:00010000:1.0:1782229017.912253:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.912255:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309540864 00010000:00010000:0.0:1782229017.912306:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 51 pid: 10359 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.912357:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:0.0:1782229017.912368:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+51:2372:x1868802309540864:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229017.912387:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229017.912395:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 51 pid: 10359 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.912412:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 51 pid: 10359 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.912844:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e63ecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994986f expref: 51 pid: 10359 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.912868:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:0.0:1782229017.912873:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.912884:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.912894:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.912928:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782229017.912986:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.912996:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.913019:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+50:2372:x1868802309540864:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 651us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229017.913028:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 52 00000004:00200000:1.0:1782229017.913029:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782229017.913256:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63ee1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.913280:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.913288:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229017.913290:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782229017.913293:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcde00, rc 0) 00000100:00100000:1.0:1782229017.913324:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10542:x1868802309540736:12345-192.168.204.22@tcp:101:bash.0 Request processed in 5319us (5928us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1782229017.913332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 104 00000100:00100000:0.0:1782229017.917174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229017.917351:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309541120 00000100:00100000:1.0:1782229017.917365:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309541120 00000100:00100000:1.0:1782229017.917527:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 105 00000100:00100000:1.0:1782229017.917540:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+50:10542:x1868802309541120:12345-192.168.204.22@tcp:36:bash.0 00010000:00010000:1.0:1782229017.917919:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.917937:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.917963:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782229017.918040:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1782229017.918091:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bef644e reply state 00000000d3af7340 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229017.918102:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782229017.918482:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10542:x1868802309541120:12345-192.168.204.22@tcp:36:bash.0 Request processed in 942us (1319us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1782229017.918491:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 105 00000020:00080000:1.0:1782229017.918498:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229017.922183:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.922207:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.922215:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.922221:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229017.922228:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.922246:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.922269:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229017.922272:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229017.922277:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.922283:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e63ef6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229017.923690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229017.923801:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309541248 00000100:00100000:1.0:1782229017.923813:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309541248 00000100:00100000:1.0:1782229017.923896:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 106 00000100:00100000:1.0:1782229017.923908:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10542:x1868802309541248:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229017.923951:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229017.923979:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63efd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994987d expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.924092:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.924109:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.924119:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.924172:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.924191:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 53 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229017.924233:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329478400:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229017.924342:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9840 going to sleep for 11 seconds 00000100:00100000:2.0:1782229017.929396:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229017.929582:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309541376 00000100:00100000:3.0:1782229017.929595:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309541376 00010000:00010000:3.0:1782229017.929648:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 54 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229017.929729:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:3.0:1782229017.929741:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+54:2372:x1868802309541376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229017.929763:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229017.929771:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 54 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.929789:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 54 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.929822:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229017.929828:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.929839:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.929848:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229017.929873:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229017.929957:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+54:2372:x1868802309541376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 218us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229017.929966:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 53 00010000:00010000:1.0:1782229017.930263:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e63ee8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949876 expref: 53 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229017.930284:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329478400:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229017.930316:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.930326:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.930333:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229017.930399:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782229017.930405:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229017.930488:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.930528:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e63efd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 53 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.930544:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 52 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229017.930553:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229017.930565:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229017.930569:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420200, rc 0) 00000100:00100000:1.0:1782229017.930604:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10542:x1868802309541248:12345-192.168.204.22@tcp:101:bash.0 Request processed in 6698us (6928us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229017.930611:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 106 00000100:00100000:0.0:1782229017.935173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229017.935478:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309541632 00000100:00100000:2.0:1782229017.935493:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309541632 00000100:00100000:2.0:1782229017.935563:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 29 00000100:00100000:2.0:1782229017.935575:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:10542:x1868802309541632:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:2.0:1782229017.935903:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10542:x1868802309541632:12345-192.168.204.22@tcp:35:bash.0 Request processed in 328us (744us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1782229017.935910:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 29 00010000:00010000:1.0:1782229017.979727:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229017.994576:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229017.994672:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309541760 00000100:00100000:0.0:1782229017.994686:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309541760 00000100:00100000:0.0:1782229017.994773:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 107 00000100:00100000:0.0:1782229017.994784:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+53:10548:x1868802309541760:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229017.994816:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229017.994842:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949884 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.994957:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63f12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.994974:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.994987:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229017.995061:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782229017.995065:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229017.995088:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.995116:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e63f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949884 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.995148:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63f12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949884 expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229017.995158:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229017.995161:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229017.995165:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23400, rc 0) 00000100:00100000:0.0:1782229017.995239:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10548:x1868802309541760:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 457us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229017.995247:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 107 00000100:00100000:2.0:1782229018.000185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229018.000322:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309541888 00000100:00100000:3.0:1782229018.000334:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309541888 00000100:00100000:3.0:1782229018.000410:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 108 00000100:00100000:3.0:1782229018.000421:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10548:x1868802309541888:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229018.000496:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229018.000522:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63f19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994988b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000608:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000625:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000638:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000655:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000663:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000670:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000816:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000824:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000832:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229018.000878:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782229018.000889:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229018.000916:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000929:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000951:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000958:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000965:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000973:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229018.000978:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.000985:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001001:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:3.0:1782229018.001004:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229018.001009:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001015:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e63f20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001030:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001046:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001052:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001057:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229018.001060:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001066:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001075:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe43933f00) 00010000:00010000:3.0:1782229018.001078:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229018.001081:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001087:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e63f27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001127:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63f19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001470:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.001480:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229018.001483:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782229018.001492:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916800, rc 0) 00000100:00100000:3.0:1782229018.001569:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10548:x1868802309541888:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1150us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229018.001578:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 108 00000100:00100000:0.0:1782229018.006623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229018.006675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.006895:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309542144 00000100:00100000:2.0:1782229018.006909:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309542144 00000100:00100000:2.0:1782229018.007002:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 109 00000100:00100000:2.0:1782229018.007013:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10548:x1868802309542144:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229018.007044:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229018.007075:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949892 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.007238:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.007256:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 56 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.007265:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.007273:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.007330:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.007349:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 56 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229018.007366:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329478528:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229018.007518:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 56 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.007527:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 56 pid: 10359 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229018.007537:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329478656:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229018.007564:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b180 going to sleep for 11 seconds 00000100:00100000:3.0:1782229018.010891:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309542272 00000100:00100000:3.0:1782229018.010909:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309542272 00010000:00010000:3.0:1782229018.010975:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 57 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229018.011025:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 54 00000100:00100000:3.0:1782229018.011036:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:2370:x1868802309542272:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229018.011054:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229018.011061:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 57 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.011079:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 57 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.011116:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229018.011123:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.011133:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.011168:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229018.011692:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:2370:x1868802309542272:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 655us (5013us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229018.011702:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 54 00010000:00010000:2.0:1782229018.012805:0:5797:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.22@tcp) returned -22 from blocking AST (req@000000007f71cc05 x1868802329478528) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 56 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.012831:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e63f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994988b expref: 56 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229018.012853:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329478528:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229018.013270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.013502:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329478656:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229018.013535:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:2.0:1782229018.013558:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.013570:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.013580:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229018.013935:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309542400 00000100:00100000:3.0:1782229018.013954:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309542400 00010000:00010000:3.0:1782229018.014006:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 56 pid: 10359 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229018.014144:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:3.0:1782229018.014156:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+56:2372:x1868802309542400:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229018.014174:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229018.014181:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 56 pid: 10359 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.014197:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 56 pid: 10359 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.014220:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e63f04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994987d expref: 56 pid: 10359 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.014237:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229018.014241:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.014251:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.014259:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.014290:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229018.014419:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.014427:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229018.014481:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782229018.014687:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.014705:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.014713:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:2.0:1782229018.014715:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782229018.014718:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc400, rc 0) 00000100:00100000:3.0:1782229018.014787:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+56:2372:x1868802309542400:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 632us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229018.014807:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:2.0:1782229018.015074:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10548:x1868802309542144:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 8062us (8466us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1782229018.015091:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 109 00000100:00100000:1.0:1782229018.018572:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229018.018655:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309542656 00000100:00100000:3.0:1782229018.018667:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309542656 00000100:00100000:3.0:1782229018.018789:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:3.0:1782229018.018801:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10548:x1868802309542656:12345-192.168.204.22@tcp:103:lfs.0 00010000:00010000:3.0:1782229018.018824:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229018.018855:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e63e9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949868 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.018879:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229018.018885:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229018.018996:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10548:x1868802309542656:12345-192.168.204.22@tcp:103:lfs.0 Request processed in 197us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229018.019004:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:1.0:1782229018.021653:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.021786:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309542784 00000100:00100000:2.0:1782229018.021799:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309542784 00000100:00100000:2.0:1782229018.021884:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 110 00000100:00100000:2.0:1782229018.021895:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10548:x1868802309542784:12345-192.168.204.22@tcp:58:lfs.0 00010000:00010000:2.0:1782229018.022043:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.022066:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.022256:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229018.022553:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1782229018.022665:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10548:x1868802309542784:12345-192.168.204.22@tcp:58:lfs.0 Request processed in 770us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229018.022673:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 110 00000100:00100000:2.0:1782229018.025465:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229018.025598:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309542912 00000100:00100000:1.0:1782229018.025610:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309542912 00000100:00100000:1.0:1782229018.025684:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 111 00000100:00100000:1.0:1782229018.025695:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+54:10548:x1868802309542912:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229018.025733:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229018.025762:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949899 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.025843:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.025855:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.025879:0:5798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.025895:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.025911:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229018.025932:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229018.025948:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.025956:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420e00, rc 0) 00000100:00100000:1.0:1782229018.026073:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10548:x1868802309542912:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 380us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229018.026089:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 111 00000040:00080000:3.0:1782229018.621115:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782229018.621138:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782229018.621361:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1782229018.621369:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782229018.621581:0:11549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425cb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329478784:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782229018.621730:0:11549:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41ca1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782229018.642750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229018.642960:0:11549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425cb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329478784:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782229018.643863:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309543040 00000100:00100000:1.0:1782229018.643875:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309543040 00000100:00100000:1.0:1782229018.643976:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 112 00000100:00100000:1.0:1782229018.643988:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10549:x1868802309543040:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782229018.644037:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782229018.644180:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10549:x1868802309543040:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 193us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229018.644189:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 112 00000100:00100000:1.0:1782229018.658102:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.659318:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309543168 00000100:00100000:2.0:1782229018.659332:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309543168 00000100:00100000:2.0:1782229018.659427:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 113 00000100:00100000:2.0:1782229018.659476:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10549:x1868802309543168:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782229018.659557:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659572:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659584:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659666:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659674:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659681:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659705:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659713:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659719:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229018.659761:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782229018.659766:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229018.659779:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659790:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659797:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659805:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659823:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229018.659828:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659835:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659848:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:2.0:1782229018.659851:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229018.659855:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659862:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659878:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659883:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659888:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659893:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcda00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229018.659895:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659901:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659919:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98fe58ddda00) 00010000:00010000:2.0:1782229018.659922:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229018.659935:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659942:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f5f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659957:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659963:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659968:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659973:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229018.659975:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659981:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659988:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:2.0:1782229018.659990:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229018.659993:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.659999:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229018.660096:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10549:x1868802309543168:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 Request processed in 622us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229018.660105:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 113 00000100:00100000:3.0:1782229018.670720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229018.673544:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309543424 00000100:00100000:1.0:1782229018.673576:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309543424 00000100:00100000:1.0:1782229018.673693:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 114 00000100:00100000:1.0:1782229018.673707:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:10549:x1868802309543424:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229018.673739:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229018.673770:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63f6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498a0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.673908:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.673966:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.673981:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229018.673997:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782229018.674498:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674509:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674516:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674522:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229018.674529:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674538:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674607:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229018.674611:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782229018.674617:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674624:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674692:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63f6d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498a0 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674715:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:1.0:1782229018.674718:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229018.674722:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e63f6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498a0 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.674733:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421000, rc 0) 00000100:00100000:1.0:1782229018.674843:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10549:x1868802309543424:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 1139us (4139us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1782229018.674853:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 114 00000100:00100000:3.0:1782229018.679342:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.679536:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309543552 00000100:00100000:2.0:1782229018.679561:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309543552 00000100:00100000:2.0:1782229018.679635:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 115 00000100:00100000:2.0:1782229018.679648:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10549:x1868802309543552:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782229018.679727:0:5798:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782229018.679867:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10549:x1868802309543552:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 221us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229018.679877:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 115 00000100:00100000:0.0:1782229018.698843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.699055:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309543808 00000100:00100000:2.0:1782229018.699070:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309543808 00000100:00100000:2.0:1782229018.699152:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 116 00000100:00100000:2.0:1782229018.699165:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10549:x1868802309543808:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229018.699197:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229018.699201:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782229018.699236:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e63f12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949884 expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.699261:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229018.699267:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229018.699283:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498a7 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782229018.701862:0:10359:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1782229018.706892:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.706918:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.706942:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.707065:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498a7 expref: 58 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.707088:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498a7 expref: 57 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.707098:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:2.0:1782229018.707101:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229018.707105:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcda00, rc 0) 00000100:00100000:2.0:1782229018.708120:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10549:x1868802309543808:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 8950us (9285us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1782229018.708143:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 116 00000100:00100000:3.0:1782229018.725737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.726635:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309544064 00000100:00100000:2.0:1782229018.726647:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309544064 00000100:00100000:2.0:1782229018.726730:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 117 00000100:00100000:2.0:1782229018.726742:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10549:x1868802309544064:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782229018.726830:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229018.726863:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e63f89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498a7 expref: 57 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.726883:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe58ddda00) 00010000:00010000:2.0:1782229018.726894:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229018.726916:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.726940:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.726951:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.726965:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.726973:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.726980:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727059:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727067:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727073:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727080:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229018.727089:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727097:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727106:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229018.727109:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229018.727112:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727119:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e63f97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727128:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727135:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727141:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727146:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229018.727150:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727156:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727162:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x932636c (ffff98fe58ddd200) 00010000:00010000:2.0:1782229018.727164:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229018.727172:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.727178:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e63f9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x932636c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229018.727266:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10549:x1868802309544064:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 526us (1539us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782229018.727274:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 117 00000100:00100000:3.0:1782229018.731908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229018.732089:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309544192 00000100:00100000:1.0:1782229018.732107:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309544192 00000100:00100000:1.0:1782229018.732198:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 118 00000100:00100000:1.0:1782229018.732212:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+56:10549:x1868802309544192:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229018.732252:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229018.732286:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63fa5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498ae expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.732334:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.732351:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.732364:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.732538:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e63fa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.732578:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.732589:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:1.0:1782229018.732592:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782229018.732595:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421e00, rc 0) 00000100:00100000:1.0:1782229018.732669:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10549:x1868802309544192:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 460us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229018.732676:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 118 00000100:00100000:1.0:1782229018.754866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.759472:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309544448 00000100:00100000:2.0:1782229018.759487:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309544448 00000100:00100000:0.0:1782229018.764087:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 119 00000100:00100000:0.0:1782229018.764104:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+57:10549:x1868802309544448:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782229018.764210:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.764229:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.764241:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782229018.766935:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1782229018.766952:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331763521349ns, next at 332763517442ns, rc = 0 00000004:00010000:0.0:1782229018.767075:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000392e4f9d reply state 000000004683b048 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229018.767088:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229018.771205:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+59:10549:x1868802309544448:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 6776us (16019us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1782229018.771221:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 119 00000100:00100000:3.0:1782229018.775279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229018.775652:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309544576 00000100:00100000:1.0:1782229018.775661:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309544576 00000100:00100000:1.0:1782229018.775725:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 120 00000100:00100000:1.0:1782229018.775734:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+59:10549:x1868802309544576:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229018.775757:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229018.775891:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.775904:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.775911:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.775918:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229018.775935:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.775943:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.775960:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:2.0:1782229018.775963:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782229018.775967:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.775974:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e63fb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.776046:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498b5 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.776206:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 59 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.776218:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 59 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.776235:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:1.0:1782229018.776243:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229018.776246:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420000, rc 0) 00000100:00100000:1.0:1782229018.776384:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+59:10549:x1868802309544576:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 649us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229018.776392:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 120 00000100:00100000:1.0:1782229018.782882:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.786844:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309544704 00000100:00100000:2.0:1782229018.786863:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309544704 00000100:00100000:2.0:1782229018.787038:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 37 00000100:00100000:2.0:1782229018.787051:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309544704:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782229018.787425:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2373:x1868802309544704:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 375us (4552us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782229018.787462:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 37 00000100:00080000:3.0:1782229018.793061:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229018.797103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.803024:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309544960 00000100:00100000:2.0:1782229018.803040:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309544960 00000100:00100000:2.0:1782229018.803172:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:2.0:1782229018.803184:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+59:10549:x1868802309544960:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782229018.803479:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+60:10549:x1868802309544960:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 296us (6390us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1782229018.803488:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:1.0:1782229018.806512:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.806857:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309545216 00000100:00100000:2.0:1782229018.806868:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309545216 00000100:00100000:2.0:1782229018.806941:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 121 00000100:00100000:2.0:1782229018.806952:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+60:10549:x1868802309545216:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782229018.807080:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+60:10549:x1868802309545216:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 128us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229018.807088:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 121 00000100:00100000:3.0:1782229018.811290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229018.811613:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309545344 00000100:00100000:1.0:1782229018.811623:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309545344 00000100:00100000:1.0:1782229018.811691:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 122 00000100:00100000:1.0:1782229018.811702:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+60:10549:x1868802309545344:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229018.811735:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229018.811759:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e63fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498bc expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.811835:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e63fc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.811850:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e63fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.811862:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e63fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229018.811902:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229018.811934:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e63fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.811962:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e63fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498bc expref: 62 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.811996:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e63fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498bc expref: 61 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.812005:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:1.0:1782229018.812008:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782229018.812011:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421800, rc 0) 00000100:00100000:1.0:1782229018.812084:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+61:10549:x1868802309545344:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 384us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229018.812092:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 122 00000100:00100000:1.0:1782229018.816074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229018.816291:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309545472 00000100:00100000:0.0:1782229018.816302:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309545472 00000100:00100000:0.0:1782229018.816367:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:0.0:1782229018.816387:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2372:x1868802309545472:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229018.816406:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229018.816463:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498c3 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782229018.816516:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3aa81b, blocks: 0x1 00010000:00010000:0.0:1782229018.816536:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1782229018.816541:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229018.816551:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 10 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.816572:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 10 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.816587:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22e00, rc 0) 00000100:00100000:0.0:1782229018.816664:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2372:x1868802309545472:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 279us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229018.816671:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:2.0:1782229018.821335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229018.821678:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309545728 00000100:00100000:0.0:1782229018.821689:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309545728 00000100:00100000:0.0:1782229018.821743:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 123 00000100:00100000:0.0:1782229018.821753:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:10549:x1868802309545728:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782229018.821891:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:10549:x1868802309545728:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 138us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229018.821900:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 123 00000100:00100000:3.0:1782229018.829823:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.830111:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309545856 00000100:00100000:2.0:1782229018.830133:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309545856 00000100:00100000:2.0:1782229018.830198:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:2.0:1782229018.830208:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+10:10549:x1868802309545856:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229018.830226:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229018.830249:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498ca expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.830280:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 11 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.830289:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229018.830294:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229018.830299:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.830332:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 11 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.830348:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 11 pid: 6598 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229018.830362:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1868802329478912:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229018.830512:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b840 going to sleep for 11 seconds 00000100:00100000:2.0:1782229018.835073:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1868802329478912:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229018.835109:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.835162:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcdc00, rc 0) 00000100:00100000:2.0:1782229018.835227:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+11:10549:x1868802309545856:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 5018us (5413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229018.835236:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:1.0:1782229018.840147:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229018.840261:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309545984 00000100:00100000:0.0:1782229018.840272:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309545984 00010000:00010000:0.0:1782229018.840319:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 11 pid: 6598 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229018.840397:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:0.0:1782229018.840407:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2372:x1868802309545984:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229018.840425:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229018.840491:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 11 pid: 6598 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.840517:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 11 pid: 6598 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.840541:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001519876f/0x8e1c8a3488e63fcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498c3 expref: 11 pid: 6598 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.840557:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229018.840560:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229018.840568:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.840577:0:11530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229018.840627:0:11530:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 10 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229018.840642:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11530:1868802329479040:192.168.204.22@tcp:105: 00000100:00100000:0.0:1782229018.840735:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe47c68300 going to sleep for 11 seconds 00000100:00100000:0.0:1782229018.847173:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11530:1868802329479040:192.168.204.22@tcp:105: 00010000:00010000:0.0:1782229018.847203:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229018.847272:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2372:x1868802309545984:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6865us (7147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229018.847283:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:1.0:1782229018.851994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.852107:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309546112 00000100:00100000:2.0:1782229018.852119:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309546112 00002000:00100000:2.0:1782229018.852191:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98fe7bc10380 x1868802309546112/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:189/0 lens 504/0 e 0 to 0 dl 1782229029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229018.852205:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe7bc10380 with x1868802309546112 ext(0->12) 00002000:00010000:2.0:1782229018.852211:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe7bc10380 00000100:00100000:2.0:1782229018.852254:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:2.0:1782229018.852266:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2373:x1868802309546112:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782229018.853400:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+12:2373:x1868802309546112:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 Request processed in 1130us (1412us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782229018.853410:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2 00002000:00100000:2.0:1782229018.853420:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98fe7bc10380 x1868802309546112/t4294967308(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:189/0 lens 504/448 e 0 to 0 dl 1782229029 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229018.854244:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe7bc10380 with x1868802309546112 ext(0->12) 00002000:00010000:2.0:1782229018.854255:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe7bc10380 00000100:00100000:1.0:1782229018.861010:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229018.861227:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309546240 00000100:00100000:2.0:1782229018.861238:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309546240 00000100:00100000:2.0:1782229018.861349:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 124 00000100:00100000:2.0:1782229018.861360:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+61:10549:x1868802309546240:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1782229018.955106:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1782229018.955121:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1782229018.955142:0:5818:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1782229018.955405:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1782229018.955418:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1782229018.956622:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329479168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782229018.956698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229018.956774:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782229018.956781:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329479296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782229018.956808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229018.956851:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329479168 00000100:00100000:1.0:1782229018.956857:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329479168 00000100:00100000:1.0:1782229018.956908:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329479296 00000100:00100000:1.0:1782229018.956911:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329479296 00000100:00100000:1.0:1782229018.956942:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782229018.956950:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1868802329479168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782229018.956975:0:6600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1782229018.957014:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.957036:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 11 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.957045:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782229018.957049:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229018.957054:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.957080:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 11 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.957098:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 11 pid: 8488 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229018.957110:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1868802329479424:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229018.957166:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce99c0 going to sleep for 11 seconds 00000100:00080000:1.0:1782229018.957179:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229018.957193:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782229018.957199:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe66070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1868802329479296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1782229018.957376:0:8488:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782229018.957380:0:8488:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782229019 00002000:00010000:1.0:1782229018.957382:0:8488:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782229018.957385:0:8488:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782229019 -> 1782229019 00002000:00010000:1.0:1782229018.957387:0:8488:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782229018.957464:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe66070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1868802329479296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 263us (653us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782229018.957471:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1782229018.957616:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe779f3b80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1782229018.957623:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329479296:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1782229018.960661:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:3.0:1782229018.960685:0:5818:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe5096b480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1782229018.960690:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe68efa400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe5096ba80 00000020:00080000:3.0:1782229018.960694:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe68efa500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fe743c5400 00000020:00080000:0.0:1782229018.960743:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:1.0:1782229018.961053:0:11882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1782229018.961073:0:11882:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe50b8b0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1782229018.961077:0:11882:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe53907500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe50b8bcc0 00000020:00080000:1.0:1782229018.961080:0:11882:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe53907a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fe741e0000 00000004:00080000:3.0:1782229018.961154:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1782229018.961399:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+20:10549:x1868802309546240:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 Request processed in 100036us (100395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229018.961413:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 124 00000020:00080000:0.0:1782229018.962138:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1782229018.962351:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1782229018.962714:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329479552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782229018.962770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229018.962850:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329479552 00000100:00100000:3.0:1782229018.962858:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329479552 00000100:00100000:3.0:1782229018.962982:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782229018.963001:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1868802329479552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782229018.963034:0:8488:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1782229018.963065:0:8488:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3aa819, atime: 0x6a3aa819, ctime: 0x6a3aa819, blocks: 0x1 00010000:00010000:3.0:1782229018.963074:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.963089:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1782229018.963093:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229018.963099:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.963114:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.963138:0:8488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.963160:0:8488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229018.963177:0:8488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1782229018.963871:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782229018.964616:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229018.964625:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.964637:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229018.964641:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.964651:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.964673:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.964681:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392b5046/0x8e1c8a3488e63fe4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.964719:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229018.964721:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229018.964723:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229018.965078:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3308:x1868802329479552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2083us (2304us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782229018.965089:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782229018.965748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229018.965779:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309546368 00000100:00100000:1.0:1782229018.965788:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309546368 00010000:00010000:1.0:1782229018.965827:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 12 pid: 8488 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229018.965861:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:1.0:1782229018.965870:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+12:2372:x1868802309546368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229018.965887:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229018.965893:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 12 pid: 8488 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.965909:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 12 pid: 8488 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.965945:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229018.965950:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229018.965955:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.965965:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229018.966003:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229018.966049:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+12:2372:x1868802309546368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 180us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229018.966057:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 57 00010000:00010000:2.0:1782229018.966194:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000225e6325/0x8e1c8a3488e63d9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949829 expref: 11 pid: 8488 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229018.966209:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1868802329479424:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229018.966231:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.966241:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.966248:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.966257:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.966264:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.966281:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782229018.967038:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1868802329479168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10086us (10337us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782229018.967054:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1782229018.967238:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229018.967244:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.967255:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229018.967259:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.967269:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.967284:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.967291:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e63fdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229018.967309:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229018.967311:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229018.967313:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782229018.967466:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe7bc11500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1782229018.967473:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329479552:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782229018.968334:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe779f1180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1782229018.968342:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329479168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782229018.976302:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229018.976480:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309546496 00000100:00100000:0.0:1782229018.976690:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309546496 00000100:00100000:2.0:1782229018.977299:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:2.0:1782229018.977312:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2372:x1868802309546496:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1782229019.007744:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229019.040345:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2372:x1868802309546496:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 Request processed in 63024us (64041us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229019.040358:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 43 00000001:00080000:0.0:1782229019.041258:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1782229019.041269:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1782229019.041276:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1782229019.041283:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1782229019.041288:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1782229019.053251:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229019.054189:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309546752 00000100:00100000:0.0:1782229019.054201:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309546752 00000100:00100000:0.0:1782229019.054294:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 125 00000100:00100000:0.0:1782229019.054305:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+15:10549:x1868802309546752:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782229019.054382:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229019.054414:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e63fc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498bc expref: 15 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229019.054473:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:0.0:1782229019.054478:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229019.054685:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229019.054702:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229019.054713:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229019.054979:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031a8b3c3 reply state 00000000625c5ae3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229019.054990:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:1.0:1782229019.055457:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229019.056833:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+16:10549:x1868802309546752:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 2520us (3582us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1782229019.056844:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 125 00000100:00100000:1.0:1782229019.076755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00010000:00010000:3.0:1782229019.077606:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.077621:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.077628:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.077634:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229019.077639:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.077646:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.077665:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:3.0:1782229019.077668:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229019.077672:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.077700:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e63feb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229019.077928:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309546880 00000100:00100000:0.0:1782229019.077939:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309546880 00000100:00100000:0.0:1782229019.078003:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:0.0:1782229019.078013:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309546880:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782229019.078479:0:8488:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782229019.078484:0:8488:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1782229019 -> 1782229018 00002000:00010000:0.0:1782229019.078487:0:8488:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782229017 00002000:00010000:0.0:1782229019.078496:0:8488:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782229019 -> 1782229018 00002000:00010000:0.0:1782229019.078498:0:8488:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782229019.078563:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309546880:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 551us (1817us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782229019.078571:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:0.0:1782229019.083036:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229019.083230:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309547136 00000100:00100000:3.0:1782229019.083239:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309547136 00000100:00100000:3.0:1782229019.083328:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 126 00000100:00100000:3.0:1782229019.083337:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:10549:x1868802309547136:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782229019.083405:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.083422:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.083453:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.083490:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.083507:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 15 pid: 5796 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229019.083522:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329479680:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229019.083661:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1782229019.089950:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329479680:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229019.089983:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229019.090190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229019.090268:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309547264 00000100:00100000:1.0:1782229019.090275:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309547264 00010000:00010000:1.0:1782229019.090312:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 16 pid: 5796 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229019.090348:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:1.0:1782229019.090357:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+16:2372:x1868802309547264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229019.090372:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229019.090378:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 16 pid: 5796 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.090391:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 16 pid: 5796 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.090411:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e63fac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ae expref: 16 pid: 5796 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.090452:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:1.0:1782229019.090457:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.090467:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.090475:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.090659:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229019.090718:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+15:2372:x1868802309547264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 350us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229019.090726:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 58 00010000:00010000:2.0:1782229019.092098:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092111:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092154:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092162:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092168:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092174:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229019.092178:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092185:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092198:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:2.0:1782229019.092201:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1782229019.092205:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.092212:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e63ff2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229019.092284:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+14:10549:x1868802309547136:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 Request processed in 8944us (9254us total) trans 0 rc -22/-22 00000100:00100000:2.0:1782229019.092308:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 126 00000100:00100000:0.0:1782229019.096044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229019.096137:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309547392 00000100:00100000:1.0:1782229019.096147:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309547392 00000100:00100000:1.0:1782229019.096207:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:1.0:1782229019.096216:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309547392:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782229019.096261:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.096282:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.096290:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782229019.096294:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229019.096299:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.096349:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.096366:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 7 pid: 6599 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229019.096381:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1868802329479808:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229019.096489:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229019.100131:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1868802329479808:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229019.100163:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229019.101394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229019.102342:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309547520 00000100:00100000:1.0:1782229019.102354:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309547520 00010000:00010000:1.0:1782229019.102397:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 8 pid: 6599 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229019.102460:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 59 00000100:00100000:1.0:1782229019.102470:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309547520:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229019.102485:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229019.102506:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 8 pid: 6599 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.102521:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 8 pid: 6599 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.102559:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e63fd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ca expref: 8 pid: 6599 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.102575:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229019.102580:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229019.102586:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.102719:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.102804:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229019.102866:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309547520:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 397us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229019.102875:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 59 00010000:00010000:2.0:1782229019.104700:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104724:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104758:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104766:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104774:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104781:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229019.104785:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104794:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104811:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.104840:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e63ff9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229019.104983:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309547392:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 Request processed in 8764us (8944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229019.104991:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:0.0:1782229019.111221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229019.111329:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309547776 00000100:00100000:2.0:1782229019.111340:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309547776 00000100:00100000:2.0:1782229019.111538:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 127 00000100:00100000:2.0:1782229019.111550:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+14:10549:x1868802309547776:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782229019.111725:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.111743:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.111755:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.111971:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.111984:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 15 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.111992:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.112049:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 15 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.112077:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 15 pid: 10359 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229019.112092:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329479936:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229019.112282:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe59e43d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782229019.115326:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329479936:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229019.115354:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229019.117279:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229019.117373:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309547904 00000100:00100000:1.0:1782229019.117382:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309547904 00010000:00010000:1.0:1782229019.117419:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 16 pid: 10359 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229019.117493:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 60 00000100:00100000:1.0:1782229019.117502:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+16:2372:x1868802309547904:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229019.117518:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229019.117525:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 16 pid: 10359 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.117554:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 16 pid: 10359 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.117576:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e63fba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498b5 expref: 16 pid: 10359 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.117591:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:1.0:1782229019.117608:0:11530:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.117618:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.117626:0:11530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.117658:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229019.117703:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+15:2372:x1868802309547904:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 202us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229019.117722:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 60 00010000:00010000:2.0:1782229019.117790:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.117798:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782229019.117993:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1782229019.118141:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1782229019.118189:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1782229019.118271:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329480064:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782229019.118318:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229019.118351:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe59e43900 going to sleep for 11 seconds 00000100:00100000:1.0:1782229019.118564:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329480064 00000100:00100000:1.0:1782229019.118569:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329480064 00000100:00100000:1.0:1782229019.118617:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782229019.118625:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1868802329480064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782229019.118705:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1868802329480064:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229019.118712:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782229019.119218:0:5798:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1782229019.119224:0:5798:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1782229019.119243:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe779f3b80, transno 4294967309 00000004:00080000:2.0:1782229019.119269:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe779f1180, transno 4294967310 00000100:00100000:2.0:1782229019.119277:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329480064:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1782229019.119761:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1782229019.119821:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329480192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782229019.119860:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229019.119887:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe59e43d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782229019.120959:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329480192 00000100:00100000:1.0:1782229019.120968:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329480192 00000100:00100000:1.0:1782229019.121022:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782229019.121030:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1868802329480192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782229019.121240:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1868802329480192:12345-0@lo:1000:mdt00_002.0 Request processed in 209us (1377us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1782229019.121248:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782229019.121331:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329480192:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1782229019.121370:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121381:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121389:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121395:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229019.121399:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121406:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121421:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe439add00) 00010000:00010000:3.0:1782229019.121424:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782229019.121454:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121461:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64007 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121490:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121496:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121516:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121520:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229019.121523:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121530:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121538:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229019.121540:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782229019.121548:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121560:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121570:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.121611:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229019.121625:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329480320:192.168.204.22@tcp:105: 00000100:00100000:3.0:1782229019.121702:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1782229019.126608:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329480320:192.168.204.22@tcp:105: 00010000:00010000:3.0:1782229019.126660:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126671:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e63f4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126708:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126723:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126735:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126747:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126753:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126760:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126766:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229019.126771:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126779:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126791:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229019.126795:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229019.126805:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126812:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6400e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126824:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126830:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126836:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126842:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcda00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229019.126846:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126852:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126860:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229019.126862:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782229019.126866:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.126872:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64000 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229019.127314:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782229019.127319:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782229019.127835:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1782229019.127844:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782229019.127979:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+18:10549:x1868802309547776:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 16428us (16766us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1782229019.127990:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 127 00000020:00080000:3.0:1782229019.128006:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1782229019.131751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229019.131854:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309548032 00000100:00100000:1.0:1782229019.131866:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309548032 00000100:00100000:1.0:1782229019.131944:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 31 00000100:00100000:1.0:1782229019.131955:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+18:10548:x1868802309548032:12345-192.168.204.22@tcp:49:lfs.0 00000100:00100000:1.0:1782229019.132097:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+18:10548:x1868802309548032:12345-192.168.204.22@tcp:49:lfs.0 Request processed in 144us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229019.132104:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 31 00000100:00100000:3.0:1782229019.132543:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229019.133623:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309548288 00000100:00100000:1.0:1782229019.133632:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309548288 00000100:00100000:1.0:1782229019.133668:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:1.0:1782229019.133677:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+18:10549:x1868802309548288:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782229019.138072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229019.138203:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309548544 00000100:00100000:3.0:1782229019.138213:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309548544 00000100:00100000:3.0:1782229019.138276:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 128 00000100:00100000:3.0:1782229019.138288:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+20:10548:x1868802309548544:12345-192.168.204.22@tcp:58:lfs.0 00000004:00080000:2.0:1782229019.142194:0:5800:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782229019.142895:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000040:00080000:1.0:1782229019.142979:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:2.0:1782229019.142996:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.143015:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229019.143239:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+21:10548:x1868802309548544:12345-192.168.204.22@tcp:58:lfs.0 Request processed in 4947us (5178us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229019.143249:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 128 00010000:00010000:2.0:1782229019.143600:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.143611:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.143619:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.143625:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.143646:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782229019.143707:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+20:10549:x1868802309548288:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 10031us (11165us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1782229019.143716:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 32 00000020:00080000:2.0:1782229019.143720:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782229019.143846:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229019.143853:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.143862:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dccc00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229019.143872:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.143881:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.143894:0:6613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98fe58ddd200) 00010000:00010000:1.0:1782229019.143897:0:6613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782229019.143901:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.143907:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e64015 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229019.143935:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229019.143937:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229019.143938:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229019.214117:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229019.214229:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309548672 00000100:00100000:2.0:1782229019.214240:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309548672 00000100:00100000:2.0:1782229019.214304:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 129 00000100:00100000:2.0:1782229019.214316:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+20:10552:x1868802309548672:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229019.214342:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229019.214364:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e6401c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498d1 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214472:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214488:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214500:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214516:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214524:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214531:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214842:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214862:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214871:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214905:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.214932:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 21 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229019.215348:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329480448:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229019.215605:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe59e439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782229019.224366:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229019.224493:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329480448:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229019.224521:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229019.225892:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309548928 00000100:00100000:3.0:1782229019.225903:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309548928 00000100:00100000:3.0:1782229019.225990:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:3.0:1782229019.226001:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:9962:x1868802309548928:12345-192.168.204.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782229019.226536:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+23:9962:x1868802309548928:12345-192.168.204.22@tcp:35:ldlm_bl.0 Request processed in 536us (2182us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1782229019.226545:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:2.0:1782229019.234587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229019.235039:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309549056 00000100:00100000:3.0:1782229019.235050:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309549056 00010000:00010000:3.0:1782229019.235092:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 23 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229019.235288:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:3.0:1782229019.235300:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+23:2373:x1868802309549056:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229019.235315:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229019.235322:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 23 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.235336:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 23 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.235391:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e63f3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949892 expref: 23 pid: 5797 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.235406:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:3.0:1782229019.235411:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.235420:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.235427:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229019.235499:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229019.235547:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:2373:x1868802309549056:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 249us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229019.235555:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 61 00010000:00010000:2.0:1782229019.238897:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.238927:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229019.238981:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782229019.238985:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229019.239007:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239034:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239070:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239078:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239086:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239091:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229019.239095:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239103:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239131:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:2.0:1782229019.239135:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229019.239142:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239148:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64023 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239165:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239172:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239177:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239189:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcda00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229019.239192:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239197:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239205:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98fe58ddda00) 00010000:00010000:2.0:1782229019.239208:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229019.239211:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239216:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6402a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239265:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e6401c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498d1 expref: 22 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239280:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498d1 expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229019.239287:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:2.0:1782229019.239289:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229019.239292:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd600, rc 0) 00000100:00100000:2.0:1782229019.239357:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+21:10552:x1868802309548672:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 25043us (25248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229019.239366:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 129 00000001:00080000:1.0:1782229019.345237:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1782229019.345351:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1782229019.345566:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:2.0:1782229020.027575:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782229020.156503:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782229020.156513:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782229020.156590:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1782229020.156600:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229020.158471:0:11549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d17b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329480576:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782229020.158584:0:11549:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe59e43f00 going to sleep for 11 seconds 00000040:00080000:1.0:1782229020.166461:0:11924:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782229020.166470:0:11924:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782229020.166519:0:11924:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782229020.166526:0:11924:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229020.172941:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229020.172978:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309549184 00000100:00100000:2.0:1782229020.172988:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309549184 00000100:00100000:2.0:1782229020.173053:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 130 00000100:00100000:2.0:1782229020.173064:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:10563:x1868802309549184:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782229020.173885:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782229020.174335:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:10563:x1868802309549184:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 1269us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229020.174347:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 130 00000100:00100000:2.0:1782229020.174409:0:11549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d17b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329480576:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782229020.195984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229020.196173:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309549440 00000100:00100000:1.0:1782229020.196182:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309549440 00000100:00100000:1.0:1782229020.196287:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 131 00000100:00100000:1.0:1782229020.196299:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+21:10563:x1868802309549440:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229020.196324:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229020.196348:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64038 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498d8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229020.196500:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6403f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229020.196514:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6403f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229020.196525:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6403f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229020.196536:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782229020.196779:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64038 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498d8 expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229020.196808:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6403f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498d8 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229020.196816:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:1.0:1782229020.196819:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229020.196821:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420600, rc 0) 00000100:00100000:1.0:1782229020.196891:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+23:10563:x1868802309549440:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 594us (916us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1782229020.196910:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 131 00000100:00100000:2.0:1782229020.203024:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229020.203298:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309549696 00000100:00100000:0.0:1782229020.203308:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309549696 00000100:00100000:0.0:1782229020.203402:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 132 00000100:00100000:0.0:1782229020.203414:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+23:10563:x1868802309549696:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782229020.203530:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203548:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203571:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203776:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203785:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203791:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203797:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229020.203801:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203808:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203821:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:0.0:1782229020.203825:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782229020.203829:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229020.203835:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6404d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229020.204008:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+24:10563:x1868802309549696:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 596us (1061us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1782229020.204017:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 132 00000040:00080000:1.0:1782229020.204221:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782229020.204226:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782229020.204706:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1782229020.204715:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782229020.230010:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229020.230067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229020.230701:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309550080 00000100:00100000:3.0:1782229020.230712:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309550080 00000100:00100000:3.0:1782229020.230775:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:3.0:1782229020.230850:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:10563:x1868802309550080:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782229020.231255:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+25:10563:x1868802309550080:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 409us (1185us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1782229020.231264:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:2.0:1782229020.231418:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309549824 00000100:00100000:2.0:1782229020.231423:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309549824 00000100:00100000:2.0:1782229020.231490:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:2.0:1782229020.231498:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+25:2372:x1868802309549824:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229020.231510:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229020.231535:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6403f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498d8 expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229020.231579:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:2.0:1782229020.231585:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229020.231627:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2372:x1868802309549824:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 129us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229020.231633:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:1.0:1782229020.284668:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329480704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229020.284749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229020.286888:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329480832:0@lo:400:kworker.0 00000100:00100000:0.0:1782229020.286964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229020.287015:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782229020.287022:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329480960:0@lo:400:kworker.0 00000100:00100000:0.0:1782229020.287051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229020.287092:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329480832 00000100:00100000:0.0:1782229020.287099:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329480832 00000100:00100000:0.0:1782229020.287148:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782229020.287158:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329480832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229020.287211:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329480832:12345-0@lo:400:kworker.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229020.287218:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782229020.287253:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329481088:0@lo:400:kworker.0 00000100:00100000:0.0:1782229020.287276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229020.287317:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329480832:0@lo:400:kworker.0 00000100:00100000:1.0:1782229020.287488:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329480704 00000100:00100000:1.0:1782229020.287494:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329480704 00000100:00100000:1.0:1782229020.287533:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782229020.287540:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329480704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782229020.287568:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229020.287609:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329480704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229020.287614:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782229020.287638:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329480960 00000100:00100000:1.0:1782229020.287641:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329480960 00000100:00100000:1.0:1782229020.287664:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481088 00000100:00100000:1.0:1782229020.287667:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481088 00000100:00100000:1.0:1782229020.287683:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782229020.287688:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329480960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229020.287720:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329480960:12345-0@lo:400:kworker.0 Request processed in 32us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229020.287725:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782229020.287736:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782229020.287742:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329481088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229020.287768:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329481088:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229020.287774:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1782229020.287789:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782229020.287793:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229020.287834:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329480704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229020.287968:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329481088:0@lo:400:kworker.0 00000100:00100000:0.0:1782229020.287990:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329480960:0@lo:400:kworker.0 00000100:00100000:1.0:1782229020.289662:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329481216:0@lo:400:kworker.0 00000100:00100000:1.0:1782229020.289726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229020.290542:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481216 00000100:00100000:0.0:1782229020.290551:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481216 00000100:00100000:0.0:1782229020.290611:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782229020.290621:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329481216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782229020.291537:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229020.291558:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329481344:0@lo:400:kworker.0 00000100:00100000:3.0:1782229020.291615:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229020.293967:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481344 00000100:00100000:1.0:1782229020.293982:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481344 00000100:00100000:1.0:1782229020.294049:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782229020.294060:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329481344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229020.294140:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329481344:12345-0@lo:400:kworker.0 Request processed in 82us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229020.294146:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1782229020.294941:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229020.294982:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329481344:0@lo:400:kworker.0 00000100:00100000:0.0:1782229020.295689:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329481216:12345-0@lo:400:kworker.0 Request processed in 5067us (5960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229020.295710:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782229020.295797:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1782229020.295803:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1782229020.295832:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe77b91180, transno 4294967301 00000004:00080000:1.0:1782229020.295885:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1782229020.295906:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe7bc11500, transno 4294967304 00000100:00100000:1.0:1782229020.297520:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329481216:0@lo:400:kworker.0 00000100:00100000:1.0:1782229020.796461:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329481472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782229020.796539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229020.796694:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481472 00000100:00100000:0.0:1782229020.796702:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481472 00000100:00100000:0.0:1782229020.796757:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782229020.796766:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329481472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782229020.796801:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229020.796869:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329481472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229020.796875:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782229020.797043:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329481472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782229021.051696:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229021.257533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229021.257576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229021.257609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229021.257641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229021.257665:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229021.257755:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309550464 00000100:00100000:2.0:1782229021.257766:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309550464 00000100:00100000:2.0:1782229021.257832:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309550592 00000100:00100000:2.0:1782229021.257836:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309550592 00000100:00100000:2.0:1782229021.257862:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:2.0:1782229021.257883:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309550464:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229021.257958:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309550464:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 87us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229021.257967:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:2.0:1782229021.257983:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:2.0:1782229021.257991:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309550592:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229021.258019:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309550592:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229021.258025:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:2.0:1782229021.258042:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309550720 00000100:00100000:2.0:1782229021.258045:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309550720 00000100:00100000:2.0:1782229021.258070:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309550336 00000100:00080000:0.0:1782229021.258161:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782229021.258167:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782229021.258169:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782229021.258604:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309550336 00000100:00100000:2.0:1782229021.258658:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 140 00000100:00100000:2.0:1782229021.258666:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309550720:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229021.258707:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309550720:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 41us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229021.258713:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 140 00000100:00100000:2.0:1782229021.258725:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 141 00000100:00100000:2.0:1782229021.258732:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2373:x1868802309550336:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229021.258758:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2373:x1868802309550336:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 26us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229021.258763:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 141 00000100:00100000:1.0:1782229021.258865:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309550208 00000100:00100000:1.0:1782229021.258870:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309550208 00000100:00100000:1.0:1782229021.258916:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 289 00000100:00100000:1.0:1782229021.258923:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309550208:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229021.258957:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309550208:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 34us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229021.258963:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 289 00000100:00080000:0.0:1782229021.259409:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782229022.077357:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782229022.223198:0:11975:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782229022.223208:0:11975:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782229022.223249:0:11975:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782229022.223255:0:11975:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782229022.481272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229022.481524:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309550976 00000100:00100000:2.0:1782229022.481534:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309550976 00000100:00100000:2.0:1782229022.481598:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 133 00000100:00100000:2.0:1782229022.481608:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:10584:x1868802309550976:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229022.481629:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229022.481649:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64054 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498df expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.481749:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e6405b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.481764:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e6405b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.481776:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e6405b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229022.481786:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782229022.481927:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64054 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498df expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.481944:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e6405b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498df expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.481954:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:2.0:1782229022.481957:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782229022.481960:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dccc00, rc 0) 00000100:00100000:2.0:1782229022.482008:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+26:10584:x1868802309550976:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 402us (754us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1782229022.482014:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 133 00000100:00100000:1.0:1782229022.485614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229022.485727:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309551104 00000100:00100000:2.0:1782229022.485737:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309551104 00000100:00100000:2.0:1782229022.485790:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 134 00000100:00100000:2.0:1782229022.485799:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+26:10584:x1868802309551104:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:2.0:1782229022.485878:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485895:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485906:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485931:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485938:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485955:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485961:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229022.485965:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485972:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485984:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:2.0:1782229022.485987:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229022.485991:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.485997:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd400/0x8e1c8a3488e64069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229022.486075:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+26:10584:x1868802309551104:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 277us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229022.486083:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 134 00000100:00100000:0.0:1782229022.596839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229022.597301:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309551232 00000100:00100000:2.0:1782229022.597311:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309551232 00000100:00100000:2.0:1782229022.597372:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:2.0:1782229022.597382:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309551232:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:2.0:1782229022.597401:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229022.597422:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e64070 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498e6 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229022.597494:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3aa81a, atime: 0x6a3aa819, ctime: 0x6a3aa81a, blocks: 0xb 00010000:00010000:2.0:1782229022.597513:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1782229022.597518:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229022.597528:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e64070 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498e6 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.597546:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e64070 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498e6 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229022.597559:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd400, rc 0) 00000100:00100000:2.0:1782229022.597626:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309551232:12345-192.168.204.22@tcp:101:cat.0 Request processed in 245us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229022.597634:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:0.0:1782229022.602658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229022.602787:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309551360 00000100:00100000:2.0:1782229022.602797:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309551360 00002000:00100000:2.0:1782229022.602841:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98fe5827c380 x1868802309551360/t0(0) o3->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:193/0 lens 488/0 e 0 to 0 dl 1782229033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229022.602866:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe5827c380 with x1868802309551360 ext(0->4095) 00002000:00010000:2.0:1782229022.602872:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe5827c380 00000100:00100000:2.0:1782229022.602908:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:2.0:1782229022.602918:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309551360:12345-192.168.204.22@tcp:3:cat.0 00000100:00100000:2.0:1782229022.603178:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309551360:12345-192.168.204.22@tcp:3:cat.0 Request processed in 262us (530us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782229022.603197:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 3 00002000:00100000:2.0:1782229022.603203:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98fe5827c380 x1868802309551360/t0(0) o3->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:193/0 lens 488/4536 e 0 to 0 dl 1782229033 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229022.603209:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe5827c380 with x1868802309551360 ext(0->4095) 00002000:00010000:2.0:1782229022.603211:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe5827c380 00010000:00010000:2.0:1782229023.100020:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229024.126970:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782229024.450222:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1782229024.450238:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1782229024.465506:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:1.0:1782229024.465524:0:5818:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1782229024.465545:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1782229024.465555:0:5818:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe59e43900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1782229024.465560:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe59e3c800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe59e43e40 00000020:00080000:1.0:1782229024.465564:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe59e3c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fe50214400 00000020:00080000:0.0:1782229024.465780:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1782229024.466125:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1782229025.149059:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229025.411423:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782229025.411481:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329481600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229025.411641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229025.411760:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481600 00000100:00100000:0.0:1782229025.411770:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481600 00000100:00100000:1.0:1782229025.411853:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329482112:0@lo:400:kworker.0 00000100:00100000:0.0:1782229025.411876:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782229025.411892:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329481600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229025.411927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229025.411961:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782229025.411967:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329481728:0@lo:400:kworker.0 00000100:00100000:1.0:1782229025.411990:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229025.412012:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329482240:0@lo:400:kworker.0 00000100:00100000:1.0:1782229025.412032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229025.412054:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329481856:0@lo:400:kworker.0 00002000:00000024:0.0:1782229025.412080:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229025.412088:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229025.412108:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782229025.412115:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329481984:0@lo:400:kworker.0 00000100:00100000:1.0:1782229025.412134:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229025.412156:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329482240 00000100:00100000:1.0:1782229025.412162:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329482240 00000100:00100000:0.0:1782229025.412223:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329481600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 333us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229025.412229:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481856 00000100:00100000:0.0:1782229025.412235:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782229025.412236:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481856 00000100:00100000:1.0:1782229025.412262:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481984 00000100:00080000:0.0:1782229025.412273:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229025.412275:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481984 00000100:00080000:0.0:1782229025.412282:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782229025.412287:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229025.412307:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782229025.412311:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329482112 00000100:00100000:1.0:1782229025.412318:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329482240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229025.412320:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329482112 00000100:00100000:0.0:1782229025.412379:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782229025.412398:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329482112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229025.412399:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329482240:12345-0@lo:400:kworker.0 Request processed in 72us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229025.412421:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782229025.412480:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782229025.412488:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329481856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229025.412519:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329481856:12345-0@lo:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229025.412537:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782229025.412547:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782229025.412553:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329481984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229025.412574:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329481984:12345-0@lo:400:kworker.0 Request processed in 21us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229025.412579:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782229025.412699:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329482112:12345-0@lo:400:kworker.0 Request processed in 308us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229025.412709:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329481984:0@lo:400:kworker.0 00000100:00100000:0.0:1782229025.412716:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782229025.412736:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329481856:0@lo:400:kworker.0 00000100:00100000:0.0:1782229025.412754:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329481728 00000100:00100000:0.0:1782229025.412761:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329481728 00000100:00100000:1.0:1782229025.412804:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329482240:0@lo:400:kworker.0 00000100:00100000:0.0:1782229025.412818:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1782229025.412826:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329482112:0@lo:400:kworker.0 00000100:00100000:0.0:1782229025.412833:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329481728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229025.412890:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329481728:12345-0@lo:400:kworker.0 Request processed in 63us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229025.412898:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1782229025.412970:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329481728:0@lo:400:kworker.0 00000100:00100000:3.0:1782229025.413119:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1782229025.413126:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1782229025.413148:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329481600:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782229025.414112:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229025.928506:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329482368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782229025.928619:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229025.929441:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329482368 00000100:00100000:0.0:1782229025.929455:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329482368 00000100:00100000:0.0:1782229025.929537:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782229025.929549:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329482368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782229025.929604:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229025.929691:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329482368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229025.929699:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782229025.929770:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329482368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782229026.177210:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229026.367969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229026.369826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229026.369876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229026.369931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229026.369967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229026.370028:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309552000 00000100:00100000:1.0:1782229026.370043:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309552000 00000100:00100000:1.0:1782229026.370121:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309551616 00000100:00100000:1.0:1782229026.370124:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309551616 00000100:00100000:1.0:1782229026.370156:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 145 00000100:00100000:1.0:1782229026.370169:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309552000:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229026.370294:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309552000:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 128us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229026.370303:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 145 00000100:00100000:1.0:1782229026.370325:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 146 00000100:00100000:1.0:1782229026.370331:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2372:x1868802309551616:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229026.370369:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2372:x1868802309551616:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 38us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229026.370376:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 146 00000100:00100000:1.0:1782229026.370400:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309551744 00000100:00100000:1.0:1782229026.370403:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309551744 00000100:00100000:1.0:1782229026.370461:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309551872 00000100:00100000:1.0:1782229026.370465:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309551872 00000100:00100000:1.0:1782229026.370489:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:1.0:1782229026.370495:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309551744:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229026.370537:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309551744:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 41us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229026.370545:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:1.0:1782229026.370556:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 67 00000100:00100000:1.0:1782229026.370576:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309551872:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229026.370607:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309551872:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 32us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229026.370613:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 67 00000100:00080000:0.0:1782229026.372489:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782229026.372500:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782229026.372504:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229026.378027:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309551488 00000100:00100000:2.0:1782229026.378051:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309551488 00000100:00100000:2.0:1782229026.378163:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 291 00000100:00100000:2.0:1782229026.378186:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309551488:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229026.378325:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309551488:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 151us (10374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229026.378334:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 291 00010000:00010000:3.0:1782229027.200660:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229027.851073:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229027.851190:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309552128 00000100:00100000:2.0:1782229027.851204:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309552128 00000100:00100000:2.0:1782229027.851281:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 135 00000100:00100000:2.0:1782229027.851293:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10237:x1868802309552128:12345-192.168.204.22@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782229027.851426:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10237:x1868802309552128:12345-192.168.204.22@tcp:60:lhsmtool_posix.0 Request processed in 135us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229027.851458:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 135 00000100:00100000:3.0:1782229027.859521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229027.859676:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309552384 00000100:00100000:2.0:1782229027.859688:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309552384 00000100:00100000:2.0:1782229027.859787:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:2.0:1782229027.859800:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+13:10237:x1868802309552384:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782229027.860650:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:10237:x1868802309552384:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 847us (1138us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1782229027.860662:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:3.0:1782229028.202389:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229028.205235:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309552512 00000100:00100000:1.0:1782229028.205258:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309552512 00000100:00100000:1.0:1782229028.205389:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 136 00000100:00100000:1.0:1782229028.205417:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:11037:x1868802309552512:12345-192.168.204.22@tcp:101:lsof.0 00010000:00010000:1.0:1782229028.205486:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229028.205517:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e64077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229028.205736:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229028.205763:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229028.205778:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229028.206134:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782229028.206139:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229028.206247:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229028.206278:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e64077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229028.206313:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229028.206323:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:1.0:1782229028.206326:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782229028.206331:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421400, rc 0) 00000100:00100000:1.0:1782229028.206427:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:11037:x1868802309552512:12345-192.168.204.22@tcp:101:lsof.0 Request processed in 1027us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229028.206491:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 136 00000100:00080000:0.0:1782229028.207235:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782229028.219880:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782229028.414816:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782229028.414832:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782229028.417915:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1782229028.418081:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782229029.245314:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782229029.614704:0:11883:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1782229029.614858:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1782229029.614883:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1782229029.615073:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:3.0:1782229030.268376:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229030.524072:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329482496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782229030.524178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229030.524382:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329482496 00000100:00100000:0.0:1782229030.524393:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329482496 00000100:00100000:0.0:1782229030.524513:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782229030.524525:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329482496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782229030.524577:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782229030.524718:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782229030.525032:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329482496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 508us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229030.525041:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782229030.525461:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329482624:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.525511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229030.525540:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329483136:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.525567:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229030.525589:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782229030.525596:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329482752:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.525656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229030.525686:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329482880:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.525732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229030.525751:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782229030.525756:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329483008:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.525781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229030.525810:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329483136 00000100:00100000:1.0:1782229030.525816:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329483136 00000100:00100000:1.0:1782229030.525857:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329482752 00000100:00100000:1.0:1782229030.525860:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329482752 00000100:00100000:1.0:1782229030.525873:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329482880 00000100:00100000:1.0:1782229030.525887:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329482880 00000100:00100000:1.0:1782229030.525904:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782229030.525910:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329483136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.525960:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329483136:12345-0@lo:400:kworker.0 Request processed in 49us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229030.525967:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782229030.525981:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782229030.525987:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329482752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.526018:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329482752:12345-0@lo:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229030.526024:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782229030.526034:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782229030.526040:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329482880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.526066:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329482880:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229030.526072:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1782229030.526103:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329483008 00000100:00100000:1.0:1782229030.526107:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329483008 00000100:00100000:1.0:1782229030.526142:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782229030.526148:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.526178:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329483008:12345-0@lo:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229030.526183:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1782229030.526202:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782229030.526207:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229030.526239:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329483008:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.526250:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329482880:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.526286:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329482752:0@lo:400:kworker.0 00000100:00100000:1.0:1782229030.526296:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7be3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329483136:0@lo:400:kworker.0 00000100:00100000:2.0:1782229030.526481:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329482624 00000100:00100000:2.0:1782229030.526486:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329482624 00000100:00100000:2.0:1782229030.526516:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1782229030.526523:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329482624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229030.526568:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329482624:12345-0@lo:400:kworker.0 Request processed in 45us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229030.526574:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1782229030.526625:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329482624:0@lo:400:kworker.0 00000100:00100000:3.0:1782229030.531306:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329482496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782229031.038791:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782229031.038822:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329483264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782229031.038926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229031.039087:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329483264 00000100:00100000:1.0:1782229031.039098:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329483264 00000100:00100000:1.0:1782229031.039158:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782229031.039169:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329483264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782229031.039212:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229031.039264:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329483264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229031.039272:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782229031.039360:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329483264:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782229031.292094:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229031.489831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229031.490002:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229031.490044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229031.490067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229031.490096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229031.490156:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309553024 00000100:00100000:0.0:1782229031.490168:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309553024 00000100:00100000:0.0:1782229031.490237:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309552896 00000100:00100000:0.0:1782229031.490240:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309552896 00000100:00100000:0.0:1782229031.490265:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:0.0:1782229031.490276:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309553024:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229031.490368:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309553024:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229031.490386:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:0.0:1782229031.490404:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:0.0:1782229031.490410:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309552896:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229031.490463:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2372:x1868802309552896:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 53us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229031.490469:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:0.0:1782229031.490514:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309552640 00000100:00100000:0.0:1782229031.490517:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309552640 00000100:00100000:0.0:1782229031.490540:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 293 00000100:00100000:0.0:1782229031.490547:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309552640:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229031.490572:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2372:x1868802309552640:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229031.490578:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 293 00000100:00080000:0.0:1782229031.490618:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782229031.490624:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782229031.497342:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309552768 00000100:00100000:3.0:1782229031.497358:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309552768 00000100:00100000:3.0:1782229031.497577:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309553152 00000100:00100000:3.0:1782229031.497582:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309553152 00000100:00080000:2.0:1782229031.499946:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229031.499947:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 150 00000100:00100000:1.0:1782229031.499971:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2372:x1868802309552768:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229031.500104:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2372:x1868802309552768:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 143us (10283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229031.500113:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 150 00000100:00100000:1.0:1782229031.500145:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 151 00000100:00100000:1.0:1782229031.500154:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:2372:x1868802309553152:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229031.500186:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:2372:x1868802309553152:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 33us (10088us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229031.500192:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 151 00000001:02000400:0.0:1782229031.816336:0:12178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:37:10 (1782229030) 00010000:00010000:2.0:1782229032.315607:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229033.025569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229033.025764:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309553408 00000100:00100000:1.0:1782229033.025778:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309553408 00000100:00100000:1.0:1782229033.026035:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 137 00000100:00100000:1.0:1782229033.026048:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+13:11302:x1868802309553408:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229033.026074:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229033.026100:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64085 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498f4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.026195:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.026213:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.026226:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.026264:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.026272:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.026277:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.027427:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6409a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.027468:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6409a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.027477:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6409a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229033.027491:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782229033.027745:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.027755:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.027762:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.027770:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229033.027776:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782229033.027930:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782229033.027982:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.027999:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98fe58ddde00) 00010000:00010000:1.0:1782229033.028002:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229033.028009:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028016:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6408c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028034:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028041:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028047:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028052:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229033.028055:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028061:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028068:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98fe439ad400) 00010000:00010000:1.0:1782229033.028071:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229033.028074:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028090:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64093 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028760:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64085 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498f4 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028781:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6409a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498f4 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229033.028876:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:1.0:1782229033.028879:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229033.028882:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421200, rc 0) 00000100:00100000:1.0:1782229033.028984:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:11302:x1868802309553408:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 2938us (3429us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1782229033.028994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 137 00000100:00100000:2.0:1782229033.036201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229033.037261:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309553664 00000100:00100000:3.0:1782229033.037275:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309553664 00000100:00100000:3.0:1782229033.037462:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:3.0:1782229033.037475:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:2371:x1868802309553664:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229033.037497:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229033.037532:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6409a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498f4 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229033.037558:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:3.0:1782229033.037565:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229033.037663:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+14:2371:x1868802309553664:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 190us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229033.037671:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:2.0:1782229033.041951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229033.042389:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309553536 00000100:00100000:1.0:1782229033.042404:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309553536 00000100:00100000:1.0:1782229033.042722:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 138 00000100:00100000:1.0:1782229033.042735:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:11302:x1868802309553536:12345-192.168.204.22@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1782229033.042919:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:11302:x1868802309553536:12345-192.168.204.22@tcp:59:lhsmtool_posix.0 Request processed in 186us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229033.042928:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 138 00010000:00010000:3.0:1782229033.340956:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782229033.533599:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782229033.533609:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782229033.533659:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1782229033.533666:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782229034.363694:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782229034.714572:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1782229034.817319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229034.817473:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309553792 00000100:00100000:1.0:1782229034.817483:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309553792 00000100:00100000:1.0:1782229034.817551:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 139 00000100:00100000:1.0:1782229034.817562:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+13:11344:x1868802309553792:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229034.817595:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229034.817626:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99498fb expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.817691:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.817705:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.817716:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.817731:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.817737:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.817743:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818030:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818039:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818045:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818051:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229034.818061:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818070:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818083:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:1.0:1782229034.818086:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229034.818091:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818098:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e640af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818110:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818116:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818122:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818127:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229034.818130:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818135:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818142:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98fe439ad400) 00010000:00010000:1.0:1782229034.818145:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229034.818153:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818159:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e640b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818190:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498fb expref: 14 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818200:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:1.0:1782229034.818203:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229034.818206:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498fb expref: 14 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.818216:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420400, rc 0) 00000100:00100000:1.0:1782229034.818283:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+13:11344:x1868802309553792:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 723us (975us total) trans 0 rc 301/301 00000100:00100000:1.0:1782229034.818295:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 139 00000100:00100000:3.0:1782229034.827849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229034.827942:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309554048 00000100:00100000:1.0:1782229034.827954:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309554048 00000100:00100000:1.0:1782229034.828024:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 140 00000100:00100000:1.0:1782229034.828036:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+13:11344:x1868802309554048:12345-192.168.204.22@tcp:36:lfs.0 00010000:00010000:1.0:1782229034.828099:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229034.828128:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe414a0c00/0x8e1c8a3488e63a26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949734 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.828150:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:1.0:1782229034.828155:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782229034.828482:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.828499:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 5 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.828508:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.828543:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 5 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.828560:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 5 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229034.828576:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329483392:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229034.828675:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5be8e540 going to sleep for 11 seconds 00000100:00100000:1.0:1782229034.840019:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329483392:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229034.840051:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229034.841928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229034.843619:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309554176 00000100:00100000:3.0:1782229034.843632:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309554176 00010000:00010000:3.0:1782229034.843726:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 6 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229034.843774:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:3.0:1782229034.843784:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4188f868-851e-4c26-a016-17a3b5288455+6:2372:x1868802309554176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229034.843799:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229034.843806:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 6 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.844984:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 6 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845024:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e6407e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498ed expref: 6 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845038:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:3.0:1782229034.845044:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845054:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845060:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229034.845158:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229034.845230:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2372:x1868802309554176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 1446us (3309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229034.845240:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 62 00010000:00010000:3.0:1782229034.845774:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845784:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845818:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845829:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.845837:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229034.847045:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782229034.847058:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.847073:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.847080:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.847086:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229034.847091:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.847098:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.847112:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9800) 00010000:00010000:3.0:1782229034.847115:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229034.847119:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.847125:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e640bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782229034.847143:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042ecbc10 reply state 000000006b1b41e1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229034.847152:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782229034.847249:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+14:11344:x1868802309554048:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 19213us (19409us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1782229034.847258:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 140 00000100:00080000:2.0:1782229034.847918:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782229034.854536:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.854572:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.854580:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.854587:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229034.854592:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.854600:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.854628:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98fe43933f00) 00010000:00010000:3.0:1782229034.854632:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229034.854637:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.854643:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640c4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229034.930054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229034.930324:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309554304 00000100:00100000:0.0:1782229034.930334:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309554304 00000100:00100000:0.0:1782229034.930397:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 141 00000100:00100000:0.0:1782229034.930408:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+13:11352:x1868802309554304:12345-192.168.204.22@tcp:101:lctl.0 00010000:00010000:0.0:1782229034.930485:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229034.930511:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e640cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949902 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.930576:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e640d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.930590:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e640d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.930602:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e640d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229034.930678:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782229034.930683:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229034.930707:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e640d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.930734:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e640cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949902 expref: 15 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.930753:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e640d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949902 expref: 14 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.930762:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:0.0:1782229034.930765:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229034.930769:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22000, rc 0) 00000100:00100000:2.0:1782229034.931967:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+14:11352:x1868802309554304:12345-192.168.204.22@tcp:101:lctl.0 Request processed in 1553us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229034.931978:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 141 00000100:00100000:1.0:1782229034.972159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229034.972317:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309554432 00000100:00100000:3.0:1782229034.972328:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309554432 00000100:00100000:3.0:1782229034.972391:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 142 00000100:00100000:3.0:1782229034.972401:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+14:11357:x1868802309554432:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229034.972421:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229034.972485:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949909 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972566:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972580:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972591:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972616:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972624:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972630:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972752:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e640ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972761:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e640ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972768:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e640ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229034.972808:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1782229034.972812:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229034.972835:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e640ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972857:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972863:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972870:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972876:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229034.972880:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972888:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972901:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:3.0:1782229034.972904:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229034.972908:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972913:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e640e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972926:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972931:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972937:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972947:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229034.972950:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972955:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.972963:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98fe43933f00) 00010000:00010000:3.0:1782229034.973089:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229034.973094:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.973100:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e640e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.973204:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e640d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949909 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.973220:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e640ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949909 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.973228:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229034.973230:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782229034.973232:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917c00, rc 0) 00000100:00100000:3.0:1782229034.973336:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+15:11357:x1868802309554432:12345-192.168.204.22@tcp:101:bash.0 Request processed in 936us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229034.973345:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 142 00000100:00100000:0.0:1782229034.977354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229034.977892:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309554688 00000100:00100000:3.0:1782229034.977914:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309554688 00000100:00100000:3.0:1782229034.977975:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 143 00000100:00100000:3.0:1782229034.977986:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+15:11357:x1868802309554688:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229034.978007:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229034.978028:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e640f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949910 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.978166:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.978180:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.978192:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.978206:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.978213:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.978220:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782229034.979387:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1782229034.980036:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980050:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980074:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980114:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980122:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980129:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980135:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229034.980139:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980145:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980158:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229034.980161:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229034.980165:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980172:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e640fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782229034.980186:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001714091c reply state 000000005ff3b2a4 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229034.980195:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782229034.980236:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e640f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980251:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.980258:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933500) 00010000:00010000:3.0:1782229034.980261:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782229034.980263:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916800, rc 0) 00000100:00100000:3.0:1782229034.980391:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11357:x1868802309554688:12345-192.168.204.22@tcp:101:bash.0 Request processed in 2406us (3046us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1782229034.980409:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 143 00010000:00010000:3.0:1782229034.983896:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.983914:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.983922:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.983929:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229034.983934:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.983942:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.983958:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe43933b00) 00010000:00010000:3.0:1782229034.983961:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229034.983977:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229034.983984:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64103 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229034.985889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229034.986239:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309554816 00000100:00100000:2.0:1782229034.986250:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309554816 00000100:00100000:2.0:1782229034.986365:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:2.0:1782229034.986376:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309554816:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229034.986394:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229034.986734:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949917 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229034.986763:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229034.986781:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1782229034.986785:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229034.986796:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229034.986814:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229034.986827:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc400, rc 0) 00000100:00100000:2.0:1782229034.986879:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2370:x1868802309554816:12345-192.168.204.22@tcp:101:bash.0 Request processed in 505us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229034.986885:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00080000:0.0:1782229034.987175:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782229034.990471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229034.990577:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309554944 00000100:00100000:0.0:1782229034.990587:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309554944 00000100:00100000:0.0:1782229034.990895:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:0.0:1782229034.990906:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+6:11357:x1868802309554944:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229034.990923:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229034.990940:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994991e expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.991079:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.991089:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229034.991093:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229034.991098:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.991202:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.991219:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 7 pid: 6600 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229034.991234:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6598:1868802329483520:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229034.992129:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92540 going to sleep for 11 seconds 00000100:00100000:0.0:1782229034.998507:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6598:1868802329483520:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229034.998542:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 7 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229034.998577:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23c00, rc 0) 00000100:00100000:0.0:1782229034.998784:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:11357:x1868802309554944:12345-192.168.204.22@tcp:101:bash.0 Request processed in 7879us (8360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229034.998793:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:2.0:1782229035.002295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.002624:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309555072 00000100:00100000:1.0:1782229035.002638:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309555072 00010000:00010000:1.0:1782229035.002696:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 7 pid: 6600 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229035.002767:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:1.0:1782229035.002779:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309555072:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229035.002798:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229035.002831:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 7 pid: 6600 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.002851:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 7 pid: 6600 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.002881:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64118 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949917 expref: 7 pid: 6600 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.002904:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229035.002908:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229035.002917:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.002928:0:11530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.002974:0:11530:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229035.003024:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11530:1868802329483648:192.168.204.22@tcp:105: 00000100:00100000:1.0:1782229035.003184:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5be8e540 going to sleep for 11 seconds 00000100:00100000:0.0:1782229035.009520:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.010039:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11530:1868802329483648:192.168.204.22@tcp:105: 00010000:00010000:1.0:1782229035.010074:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229035.010165:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309555072:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7388us (7886us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.010180:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:2.0:1782229035.011955:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309555328 00000100:00100000:2.0:1782229035.011973:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309555328 00000100:00100000:2.0:1782229035.012235:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:2.0:1782229035.012248:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+17:11357:x1868802309555328:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:2.0:1782229035.012784:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11357:x1868802309555328:12345-192.168.204.22@tcp:35:bash.0 Request processed in 536us (3278us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1782229035.012793:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00080000:0.0:1782229035.014718:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229035.094671:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.094812:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309555584 00000100:00100000:1.0:1782229035.094826:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309555584 00000100:00100000:1.0:1782229035.094899:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 144 00000100:00100000:1.0:1782229035.094911:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11369:x1868802309555584:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229035.094945:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229035.094973:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949925 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229035.095141:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782229035.095314:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64126 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949925 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.095333:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:1.0:1782229035.095337:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229035.095344:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949925 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.095361:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421e00, rc 0) 00000100:00100000:1.0:1782229035.095527:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+19:11369:x1868802309555584:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 618us (871us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1782229035.095535:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 144 00000100:00100000:3.0:1782229035.105028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229035.106071:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309555840 00000100:00100000:2.0:1782229035.106088:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309555840 00000100:00100000:2.0:1782229035.106311:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 37 00000100:00100000:2.0:1782229035.106324:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+19:11369:x1868802309555840:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:2.0:1782229035.106704:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+20:11369:x1868802309555840:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 381us (1689us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1782229035.106714:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 37 00000100:00100000:0.0:1782229035.193586:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.193719:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309555968 00000100:00100000:1.0:1782229035.193732:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309555968 00000100:00100000:1.0:1782229035.193807:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 145 00000100:00100000:1.0:1782229035.193819:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+20:11375:x1868802309555968:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229035.193848:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229035.193873:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994992c expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.193973:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e6413b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.193988:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e6413b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.194004:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e6413b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229035.194082:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782229035.194086:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229035.194112:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e6413b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.194141:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994992c expref: 22 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.194163:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e6413b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994992c expref: 21 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.194196:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229035.194200:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782229035.194204:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420c00, rc 0) 00000100:00100000:1.0:1782229035.194292:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+21:11375:x1868802309555968:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 475us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.194299:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 145 00000100:00100000:0.0:1782229035.204641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.205812:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309556224 00000100:00100000:1.0:1782229035.205826:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309556224 00000100:00100000:1.0:1782229035.205989:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 146 00000100:00100000:1.0:1782229035.206001:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+21:11375:x1868802309556224:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229035.206029:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229035.206056:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64142 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949933 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.208538:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.208568:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.208584:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229035.208618:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782229035.208834:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64142 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949933 expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.208881:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949933 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.208892:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933500) 00010000:00010000:1.0:1782229035.208895:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229035.208900:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420600, rc 0) 00000100:00100000:1.0:1782229035.210180:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+23:11375:x1868802309556224:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 4173us (5548us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1782229035.210192:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 146 00000100:00100000:2.0:1782229035.220625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.220885:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309556608 00000100:00100000:1.0:1782229035.220897:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309556608 00000100:00100000:1.0:1782229035.221030:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 147 00000100:00100000:1.0:1782229035.221050:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+23:11375:x1868802309556608:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229035.221095:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229035.221133:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994993a expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.221305:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6415e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.221328:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6415e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.221341:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6415e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229035.221356:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782229035.221676:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994993a expref: 26 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.221710:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6415e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994993a expref: 25 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.221723:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933500) 00010000:00010000:1.0:1782229035.221747:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782229035.221752:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420000, rc 0) 00000100:00100000:1.0:1782229035.221836:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+25:11375:x1868802309556608:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 791us (1238us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1782229035.221845:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 147 00000100:00100000:2.0:1782229035.223096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.223348:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309556352 00000100:00100000:1.0:1782229035.223358:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309556352 00000100:00100000:1.0:1782229035.223457:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:1.0:1782229035.223468:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+25:2372:x1868802309556352:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229035.223486:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229035.223520:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949933 expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.223549:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933500) 00010000:00010000:1.0:1782229035.223557:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229035.223646:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:2372:x1868802309556352:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 177us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.223660:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:0.0:1782229035.238413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.238660:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309556736 00000100:00100000:3.0:1782229035.238679:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309556736 00000100:00100000:3.0:1782229035.238960:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:3.0:1782229035.238974:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2372:x1868802309556736:12345-192.168.204.22@tcp:1:lfs.0 00010000:00010000:3.0:1782229035.239038:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.239066:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.239075:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782229035.239080:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229035.239085:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.239131:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 6 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.239151:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 6 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229035.239169:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1868802329483776:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229035.239375:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782229035.253305:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1868802329483776:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229035.253354:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229035.253748:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229035.254009:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309556864 00000100:00100000:2.0:1782229035.254020:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309556864 00002000:00100000:2.0:1782229035.254089:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98fe7b75e680 x1868802309556864/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:206/0 lens 504/0 e 0 to 0 dl 1782229046 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229035.254101:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe7b75e680 with x1868802309556864 ext(0->12) 00010000:00010000:2.0:1782229035.254110:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 7 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.254129:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 7 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229035.254137:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe7b75e680 00000100:00100000:2.0:1782229035.254179:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:2.0:1782229035.254208:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309556864:12345-192.168.204.22@tcp:4:lfs.0 00000100:00100000:2.0:1782229035.254944:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2373:x1868802309556864:12345-192.168.204.22@tcp:4:lfs.0 Request processed in 731us (1714us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782229035.254955:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2 00002000:00100000:2.0:1782229035.254964:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98fe7b75e680 x1868802309556864/t4294967305(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:206/0 lens 504/448 e 0 to 0 dl 1782229046 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229035.254972:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe7b75e680 with x1868802309556864 ext(0->12) 00010000:00010000:2.0:1782229035.254979:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 9 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.254998:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 9 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229035.255007:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe7b75e680 00000100:00100000:0.0:1782229035.261680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.262211:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309556992 00000100:00100000:3.0:1782229035.262224:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309556992 00010000:00010000:3.0:1782229035.262282:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 9 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229035.262397:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:3.0:1782229035.262409:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2371:x1868802309556992:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229035.262472:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782229035.262499:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782229035.262503:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782229035 00002000:00010000:3.0:1782229035.262506:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782229035 00002000:00010000:3.0:1782229035.262509:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782229035 00010000:00010000:3.0:1782229035.262516:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 9 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.262536:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 9 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.262567:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e6411f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994991e expref: 9 pid: 6598 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.262626:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229035.262631:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229035.262639:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.262651:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.262683:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229035.262724:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.262737:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229035.262776:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2371:x1868802309556992:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 368us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229035.262785:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 64 00010000:00010000:0.0:1782229035.263175:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.263183:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.263189:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.263202:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229035.263206:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.263212:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.263222:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.263226:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e2885dc/0x8e1c8a3488e6416c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229035.263317:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309556736:12345-192.168.204.22@tcp:1:lfs.0 Request processed in 24347us (24920us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229035.263323:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:0.0:1782229035.270941:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.271188:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309557248 00000100:00100000:1.0:1782229035.271203:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309557248 00000100:00100000:1.0:1782229035.271294:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:1.0:1782229035.271306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+24:11375:x1868802309557248:12345-192.168.204.22@tcp:35:lfs.0 00000004:00010000:1.0:1782229035.271393:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6415e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994993a expref: 24 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782229035.271878:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1782229035.271930:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1782229035.274170:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1782229035.274302:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.274331:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.274341:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.274396:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.274418:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 28 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229035.275864:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1868802329483904:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229035.276004:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe41254900 going to sleep for 11 seconds 00000100:00100000:1.0:1782229035.289705:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1868802329483904:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229035.289761:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229035.299487:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.299985:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309557376 00000100:00100000:1.0:1782229035.299998:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309557376 00010000:00010000:1.0:1782229035.300055:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 29 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229035.300107:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 65 00000100:00100000:1.0:1782229035.300118:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+29:2372:x1868802309557376:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229035.300138:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229035.300145:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 29 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.300163:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 29 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.300192:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e6410a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949910 expref: 29 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.300210:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933500) 00010000:00010000:1.0:1782229035.300216:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.300226:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.300235:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.300278:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229035.300369:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503f9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+28:2372:x1868802309557376:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 252us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.300377:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 65 00010000:00010000:3.0:1782229035.300560:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.300569:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782229035.300766:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1782229035.301035:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1782229035.301171:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329484032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782229035.301238:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229035.301280:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5019c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229035.302512:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484032 00000100:00100000:1.0:1782229035.302525:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484032 00000100:00100000:1.0:1782229035.302627:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782229035.302638:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5799:x1868802329484032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782229035.302786:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5799:x1868802329484032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 150us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.302795:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782229035.303138:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329484032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782229035.305496:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1782229035.305651:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329484160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782229035.305753:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229035.306042:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb80000 going to sleep for 11 seconds 00000100:00080000:0.0:1782229035.306147:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782229035.306301:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484160 00000100:00100000:1.0:1782229035.306312:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484160 00000100:00100000:1.0:1782229035.306379:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782229035.306390:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5799:x1868802329484160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782229035.306708:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5799:x1868802329484160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 319us (970us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782229035.306717:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782229035.307105:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1868802329484160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782229035.307190:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1782229035.307245:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.307258:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.307266:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.307295:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229035.307301:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.307310:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.307330:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933500) 00010000:00010000:2.0:1782229035.307333:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782229035.307339:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229035.307345:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64173 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782229035.307670:0:5799:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782229035.308252:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1782229035.308269:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348304837331ns, next at 349304834404ns, rc = 0 00000001:00080000:2.0:1782229035.308280:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1782229035.308324:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933500) 00010000:00010000:2.0:1782229035.308328:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782229035.308338:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6415e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994993a expref: 32 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229035.308694:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+31:11375:x1868802309557248:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 37389us (37767us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1782229035.308706:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 38 00000020:00080000:2.0:1782229035.308713:0:5799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782229035.316385:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.316606:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309557504 00000100:00100000:3.0:1782229035.316621:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309557504 00000100:00100000:3.0:1782229035.316899:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 148 00000100:00100000:3.0:1782229035.316912:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+31:11375:x1868802309557504:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229035.316945:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229035.316979:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6417a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949941 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.317063:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6417a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949941 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.317081:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6417a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949941 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.317108:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229035.317112:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782229035.317116:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917a00, rc 0) 00000100:00100000:3.0:1782229035.317235:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+32:11375:x1868802309557504:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 326us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229035.317245:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 148 00000100:00100000:2.0:1782229035.326877:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.327012:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309557760 00000100:00100000:3.0:1782229035.327025:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309557760 00000100:00100000:3.0:1782229035.327099:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:3.0:1782229035.327111:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+32:11375:x1868802309557760:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229035.327492:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+33:11375:x1868802309557760:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 382us (631us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1782229035.327501:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 39 00010000:00010000:2.0:1782229035.389385:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229035.426099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.426230:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309558016 00000100:00100000:1.0:1782229035.426245:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309558016 00000100:00100000:1.0:1782229035.426331:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 149 00000100:00100000:1.0:1782229035.426345:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+33:11385:x1868802309558016:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229035.426377:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229035.426404:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949948 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229035.426633:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782229035.426797:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64181 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949948 expref: 35 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.426834:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:1.0:1782229035.426837:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229035.426843:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e64181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949948 expref: 35 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.426862:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421e00, rc 0) 00000100:00100000:1.0:1782229035.429747:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11385:x1868802309558016:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 3385us (3645us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1782229035.429762:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 149 00000100:00100000:0.0:1782229035.436331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.436478:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309558144 00000100:00100000:1.0:1782229035.436490:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309558144 00000100:00100000:1.0:1782229035.436571:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 150 00000100:00100000:1.0:1782229035.436582:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11385:x1868802309558144:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:1.0:1782229035.437209:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437251:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437265:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437282:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437288:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437316:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437479:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437488:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.437495:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782229035.439001:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439027:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439036:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439043:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439051:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229035.439055:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439063:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439080:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229035.439097:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229035.439102:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439108:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6418f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439126:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439132:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439137:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439143:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229035.439146:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439152:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439160:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe439ad400) 00010000:00010000:1.0:1782229035.439163:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229035.439166:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439172:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439189:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439201:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439207:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439212:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229035.439215:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439221:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439229:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229035.439231:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229035.439234:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.439239:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6419d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229035.439390:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11385:x1868802309558144:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 2805us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.439414:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 150 00000100:00100000:2.0:1782229035.447307:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.447473:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309558400 00000100:00100000:3.0:1782229035.447490:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309558400 00000100:00100000:3.0:1782229035.447568:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 40 00000100:00100000:3.0:1782229035.447580:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11385:x1868802309558400:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229035.448094:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+35:11385:x1868802309558400:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 515us (801us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1782229035.448103:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 40 00000100:00100000:0.0:1782229035.482028:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.482153:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309558656 00000100:00100000:3.0:1782229035.482172:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309558656 00000100:00100000:3.0:1782229035.482275:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 151 00000100:00100000:3.0:1782229035.482291:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+35:11388:x1868802309558656:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229035.482329:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229035.482358:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994994f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482513:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482531:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482544:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482560:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482567:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482573:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482804:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482814:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482821:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229035.482834:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782229035.482945:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482952:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482960:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482966:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229035.482972:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482978:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.482992:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229035.482995:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229035.482999:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483015:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e641ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483030:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483035:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483041:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483046:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229035.483049:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483056:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483063:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe43933f00) 00010000:00010000:3.0:1782229035.483066:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229035.483068:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483073:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e641b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483127:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483142:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.483156:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229035.483159:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782229035.483161:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916c00, rc 0) 00000100:00100000:3.0:1782229035.483253:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+37:11388:x1868802309558656:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 965us (1239us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1782229035.483261:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 151 00000100:00100000:0.0:1782229035.490051:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.490203:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309558784 00000100:00100000:3.0:1782229035.490216:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309558784 00000100:00100000:3.0:1782229035.490359:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 152 00000100:00100000:3.0:1782229035.490373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+37:11388:x1868802309558784:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:3.0:1782229035.490509:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490545:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490560:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490608:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490615:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490622:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490629:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229035.490652:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490671:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490688:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229035.490692:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782229035.490698:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.490705:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229035.490794:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+37:11388:x1868802309558784:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 423us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229035.490803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 152 00000100:00100000:2.0:1782229035.493415:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.494016:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309559040 00000100:00100000:3.0:1782229035.494036:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309559040 00000100:00100000:2.0:1782229035.494210:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 41 00000100:00100000:2.0:1782229035.494221:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+37:11388:x1868802309559040:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:2.0:1782229035.494730:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+38:11388:x1868802309559040:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 508us (1329us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1782229035.494741:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 41 00000100:00100000:0.0:1782229035.643820:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7b75c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329484672:0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.643938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229035.644017:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782229035.644024:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7b75ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329484544:0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.644061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229035.644101:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484672 00000100:00100000:0.0:1782229035.644110:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484672 00000100:00100000:0.0:1782229035.644177:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484544 00000100:00100000:0.0:1782229035.644180:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484544 00000100:00100000:0.0:1782229035.644223:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782229035.644234:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.644309:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329484672:12345-0@lo:400:kworker.0 Request processed in 65us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229035.644317:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782229035.644344:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782229035.644350:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329484544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.644383:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329484544:12345-0@lo:400:kworker.0 Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.644387:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7b75df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329484288:0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.644393:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782229035.644465:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7b75ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329484544:0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.644480:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7b75c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329484672:0@lo:400:kworker.0 00000100:00100000:1.0:1782229035.644487:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782229035.644517:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229035.644627:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7b75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329484800:0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.644627:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484288 00000100:00100000:0.0:1782229035.644633:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484288 00000100:00100000:1.0:1782229035.644667:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229035.644677:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1782229035.644685:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329484288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.644730:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3310:x1868802329484288:12345-0@lo:400:kworker.0 Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229035.644751:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1782229035.644778:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484800 00000100:00100000:2.0:1782229035.644793:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484800 00000100:00100000:2.0:1782229035.644880:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782229035.644890:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329484800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229035.644951:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7b75df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3310:1868802329484288:0@lo:400:kworker.0 00000100:00100000:2.0:1782229035.644991:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329484800:12345-0@lo:400:kworker.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229035.645000:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782229035.645044:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7b75c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329484416:0@lo:400:kworker.0 00000100:00100000:1.0:1782229035.645071:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7b75ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329484800:0@lo:400:kworker.0 00000100:00100000:1.0:1782229035.645104:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782229035.645111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229035.645116:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329484928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782229035.645157:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484416 00000100:00100000:2.0:1782229035.645165:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484416 00000100:00100000:2.0:1782229035.645213:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782229035.645222:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329484416:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782229035.645803:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229035.645917:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229035.645964:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329484416:12345-0@lo:400:kworker.0 Request processed in 739us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229035.645976:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782229035.646032:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329484928 00000100:00100000:0.0:1782229035.646040:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329484928 00000100:00100000:0.0:1782229035.646088:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782229035.646097:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329484928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782229035.646155:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229035.646608:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ed0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329484928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 511us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229035.646615:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782229035.646957:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329484928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782229035.649217:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7b75c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329484416:0@lo:400:kworker.0 00000100:00100000:0.0:1782229035.775645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.775755:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309559296 00000100:00100000:1.0:1782229035.775769:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309559296 00000100:00100000:1.0:1782229035.775861:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 153 00000100:00100000:1.0:1782229035.775872:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+38:11419:x1868802309559296:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:1.0:1782229035.775904:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229035.775930:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e641ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949956 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.776064:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e641d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.776082:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e641d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.776095:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e641d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229035.776109:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782229035.776556:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e641ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949956 expref: 41 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.776577:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e641d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949956 expref: 40 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.776627:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229035.776630:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229035.776634:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420800, rc 0) 00000100:00100000:1.0:1782229035.776721:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+40:11419:x1868802309559296:12345-192.168.204.22@tcp:101:cat.0 Request processed in 850us (1091us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1782229035.776730:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 153 00000100:00100000:0.0:1782229035.783333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229035.783489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.783986:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309559680 00000100:00100000:1.0:1782229035.783999:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309559680 00000100:00100000:1.0:1782229035.784087:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:1.0:1782229035.784097:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+40:2372:x1868802309559680:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229035.784120:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229035.784224:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e641d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949956 expref: 40 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.784247:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229035.784254:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229035.784415:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309559552 00000100:00100000:3.0:1782229035.784419:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309559552 00000100:00100000:3.0:1782229035.784478:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:3.0:1782229035.784486:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+40:11419:x1868802309559552:12345-192.168.204.22@tcp:35:cat.0 00000100:00100000:3.0:1782229035.785470:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+41:11419:x1868802309559552:12345-192.168.204.22@tcp:35:cat.0 Request processed in 976us (2144us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1782229035.785482:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:1.0:1782229035.791543:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+40:2372:x1868802309559680:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 7426us (8035us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.791564:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:2.0:1782229035.879076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229035.879199:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309559936 00000100:00100000:3.0:1782229035.879212:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309559936 00000100:00100000:3.0:1782229035.879290:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 154 00000100:00100000:3.0:1782229035.879303:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+40:11425:x1868802309559936:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:3.0:1782229035.879337:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229035.879341:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782229035.879376:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e6413b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994992c expref: 40 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.879403:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229035.879409:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229035.879426:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994995d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.879643:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.879660:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.879670:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.879712:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.879732:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 40 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229035.879775:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329485056:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229035.880006:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229035.887020:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329485056:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229035.887063:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229035.888176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.888628:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309560064 00000100:00100000:1.0:1782229035.888647:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309560064 00010000:00010000:1.0:1782229035.888781:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 41 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229035.888880:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:1.0:1782229035.888899:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+41:2373:x1868802309560064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229035.888930:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229035.888945:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 41 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.888970:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 41 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.889008:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e641b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994994f expref: 41 pid: 5796 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.889035:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229035.889045:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.889062:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.889075:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.889142:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229035.889247:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+40:2373:x1868802309560064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 349us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229035.889262:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 66 00010000:00010000:0.0:1782229035.890954:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.890971:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229035.890999:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782229035.891223:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e641e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.891250:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 40 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229035.891261:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:0.0:1782229035.891278:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782229035.891282:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916e00, rc 0) 00000100:00100000:0.0:1782229035.891370:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+40:11425:x1868802309559936:12345-192.168.204.22@tcp:101:dd.0 Request processed in 12068us (12310us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1782229035.891380:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 154 00000100:00100000:0.0:1782229035.902749:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229035.902884:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309560320 00000100:00100000:1.0:1782229035.902897:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309560320 00000100:00100000:1.0:1782229035.903197:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 155 00000100:00100000:1.0:1782229035.903212:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+40:11425:x1868802309560320:12345-192.168.204.22@tcp:36:dd.0 00010000:00010000:1.0:1782229035.904257:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.904281:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229035.904295:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782229035.904366:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1782229035.904394:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000243f8b35 reply state 000000003b4925ad transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229035.904405:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782229035.905658:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+43:11425:x1868802309560320:12345-192.168.204.22@tcp:36:dd.0 Request processed in 2438us (2913us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1782229035.905670:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 155 00000020:00080000:1.0:1782229035.905677:0:10359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229035.913020:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.913045:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.913053:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.913060:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229035.913066:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.913074:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.913099:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229035.913103:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229035.913111:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229035.913118:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e641f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229036.156673:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329485184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782229036.156776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229036.157800:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329485184 00000100:00100000:1.0:1782229036.157810:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329485184 00000100:00100000:1.0:1782229036.158749:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782229036.158759:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329485184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782229036.158784:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229036.159182:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868802329485184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 424us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229036.159190:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782229036.160539:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329485184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782229036.313146:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229036.313252:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309560448 00000100:00100000:2.0:1782229036.313270:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309560448 00000100:00100000:2.0:1782229036.313330:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 156 00000100:00100000:2.0:1782229036.313341:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+42:11439:x1868802309560448:12345-192.168.204.22@tcp:101:stat.0 00010000:00010000:2.0:1782229036.313364:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229036.313385:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e641ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949964 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313476:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313489:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313503:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313518:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313525:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313531:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313652:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.313663:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.314111:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.314147:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.314163:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 43 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229036.314176:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329485312:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229036.314619:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb80300 going to sleep for 11 seconds 00000100:00100000:1.0:1782229036.320527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229036.320824:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309560704 00000100:00100000:3.0:1782229036.320833:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309560704 00000100:00100000:3.0:1782229036.320913:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:3.0:1782229036.320934:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+44:9962:x1868802309560704:12345-192.168.204.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782229036.321271:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+45:9962:x1868802309560704:12345-192.168.204.22@tcp:35:ldlm_bl.0 Request processed in 338us (753us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1782229036.321280:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:2.0:1782229036.322528:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329485312:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229036.322565:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229036.332612:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229036.332919:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309560832 00000100:00100000:3.0:1782229036.332929:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309560832 00010000:00010000:3.0:1782229036.332974:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 45 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229036.333020:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 67 00000100:00100000:3.0:1782229036.333031:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+45:2373:x1868802309560832:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229036.333048:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229036.333056:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 45 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.333072:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 45 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.333094:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e641ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994995d expref: 45 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.333112:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229036.333117:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.333127:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.333148:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.333182:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229036.333242:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+44:2373:x1868802309560832:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 212us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229036.333250:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 67 00010000:00010000:2.0:1782229036.333622:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.333631:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229036.335525:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782229036.335809:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229036.335847:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335864:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335891:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335897:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335904:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335909:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229036.335914:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335921:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335935:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:2.0:1782229036.335938:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229036.335943:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335949:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335965:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335970:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335976:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335988:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229036.335991:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.335997:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.336005:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe58ddd500) 00010000:00010000:2.0:1782229036.336008:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229036.336011:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.336017:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e6420d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.336059:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e641ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949964 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.336074:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949964 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.336082:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:2.0:1782229036.336084:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229036.336087:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc200, rc 0) 00000100:00100000:2.0:1782229036.336156:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+43:11439:x1868802309560448:12345-192.168.204.22@tcp:101:stat.0 Request processed in 22817us (23021us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229036.336165:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 156 00000100:00100000:0.0:1782229036.406270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229036.406639:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309561088 00000100:00100000:1.0:1782229036.406649:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309561088 00000100:00100000:1.0:1782229036.406713:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 157 00000100:00100000:1.0:1782229036.407945:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+43:11445:x1868802309561088:12345-192.168.204.22@tcp:36:truncate.0 00010000:00010000:1.0:1782229036.408013:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229036.408041:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64214 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949964 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.408062:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229036.408067:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782229036.408284:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.408299:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.408308:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782229036.408359:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1782229036.408385:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005020a0fe reply state 00000000c7e45cf1 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229036.408394:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782229036.408544:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+45:11445:x1868802309561088:12345-192.168.204.22@tcp:36:truncate.0 Request processed in 1821us (2294us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1782229036.408552:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 157 00000020:00080000:1.0:1782229036.408556:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229036.412560:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.412589:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.412598:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.412605:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229036.412610:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.412617:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.412632:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229036.412635:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229036.412640:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.412645:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e6421b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.412997:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229036.595581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229036.598959:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309561216 00000100:00100000:1.0:1782229036.598973:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309561216 00000100:00100000:1.0:1782229036.599410:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 158 00000100:00100000:1.0:1782229036.599422:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+44:11459:x1868802309561216:12345-192.168.204.22@tcp:101:stat.0 00010000:00010000:1.0:1782229036.599467:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229036.599488:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994996b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599557:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599593:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599605:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599620:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599627:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599634:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599753:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599762:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599788:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229036.599824:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1782229036.599829:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229036.599851:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599864:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599873:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599879:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599886:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599892:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229036.599895:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599903:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599915:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229036.599918:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229036.599922:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599939:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599954:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599961:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599966:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599971:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229036.599974:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599981:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.599991:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe439ad400) 00010000:00010000:1.0:1782229036.599994:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229036.599996:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.600001:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e64230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.600032:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.600940:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 45 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.600961:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229036.600964:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229036.600967:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421200, rc 0) 00000100:00100000:1.0:1782229036.601096:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+45:11459:x1868802309561216:12345-192.168.204.22@tcp:101:stat.0 Request processed in 1674us (5533us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229036.601104:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 158 00000100:00100000:1.0:1782229036.609261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229036.609302:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229036.609454:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309561344 00000100:00100000:0.0:1782229036.609467:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309561344 00000100:00100000:0.0:1782229036.609545:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 295 00000100:00100000:0.0:1782229036.609557:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309561344:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229036.609675:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50246050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309561344:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 119us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229036.609697:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 295 00000100:00100000:1.0:1782229036.610561:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229036.613250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229036.614077:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309561728 00000100:00100000:3.0:1782229036.614097:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309561728 00000100:00100000:2.0:1782229036.614114:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309561600 00000100:00100000:2.0:1782229036.614139:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309561600 00000100:00100000:2.0:1782229036.614195:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309561472 00000100:00100000:2.0:1782229036.614199:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309561472 00000100:00100000:3.0:1782229036.614204:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 155 00000100:00100000:3.0:1782229036.614219:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309561728:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229036.614233:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 72 00000100:00100000:2.0:1782229036.614243:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309561600:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229036.614351:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 73 00000100:00100000:0.0:1782229036.614362:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309561472:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229036.614506:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309561600:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 264us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229036.614516:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 72 00000100:00080000:1.0:1782229036.614522:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782229036.614528:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782229036.614531:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229036.614770:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4188f868-851e-4c26-a016-17a3b5288455+5:2373:x1868802309561728:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 552us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229036.614777:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 155 00000100:00100000:0.0:1782229036.618253:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309561472:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 3872us (7675us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229036.618273:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 73 00000100:00100000:1.0:1782229036.694950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229036.695203:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309561984 00000100:00100000:2.0:1782229036.695217:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309561984 00000100:00100000:2.0:1782229036.695294:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 159 00000100:00100000:2.0:1782229036.695305:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+45:11469:x1868802309561984:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229036.695333:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229036.695360:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6423e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949972 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229036.695535:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782229036.695700:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6423e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949972 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.695718:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:2.0:1782229036.695721:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229036.695727:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6423e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949972 expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.695744:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcda00, rc 0) 00000100:00100000:2.0:1782229036.696544:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+46:11469:x1868802309561984:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1233us (1614us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1782229036.696589:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 159 00000100:00100000:1.0:1782229036.710069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229036.710177:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309562240 00000100:00100000:3.0:1782229036.710190:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309562240 00000100:00100000:3.0:1782229036.710335:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:3.0:1782229036.710348:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+46:11469:x1868802309562240:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229036.710751:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+47:11469:x1868802309562240:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 405us (697us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1782229036.710760:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:1.0:1782229036.788342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229036.788470:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309562496 00000100:00100000:2.0:1782229036.788484:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309562496 00000100:00100000:2.0:1782229036.788561:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 160 00000100:00100000:2.0:1782229036.788583:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+47:11475:x1868802309562496:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229036.788615:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229036.788643:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6424c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949979 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.788784:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.788802:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 48 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.788812:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.788854:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 48 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229036.788871:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 48 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229036.788887:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329485440:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229036.789208:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb80c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782229036.792601:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329485440:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229036.792656:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229036.794246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229036.794425:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309562624 00000100:00100000:0.0:1782229036.794496:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309562624 00010000:00010000:0.0:1782229036.794557:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 49 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229036.794636:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 68 00000100:00100000:0.0:1782229036.794649:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+49:2373:x1868802309562624:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229036.794671:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229036.794678:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 49 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.794696:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 49 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.794841:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994996b expref: 49 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.794863:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:0.0:1782229036.794869:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.794880:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.794888:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.794922:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229036.795074:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+48:2373:x1868802309562624:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 426us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229036.795083:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 68 00010000:00010000:1.0:1782229036.795347:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.795356:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229036.795379:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1782229036.796345:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6424c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.796391:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 48 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.796401:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229036.796404:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782229036.796408:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc400, rc 0) 00000100:00100000:1.0:1782229036.796622:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+48:11475:x1868802309562496:12345-192.168.204.22@tcp:101:bash.0 Request processed in 8051us (8295us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1782229036.796632:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 160 00000100:00100000:1.0:1782229036.802415:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229036.802619:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309562880 00000100:00100000:0.0:1782229036.802651:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309562880 00000100:00100000:0.0:1782229036.803023:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 161 00000100:00100000:0.0:1782229036.803037:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+48:11475:x1868802309562880:12345-192.168.204.22@tcp:36:bash.0 00010000:00010000:0.0:1782229036.805246:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.805278:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.805292:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782229036.805402:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1782229036.805901:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000421218c0 reply state 00000000f0dcb9aa transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229036.805915:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229036.806661:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+51:11475:x1868802309562880:12345-192.168.204.22@tcp:36:bash.0 Request processed in 3618us (4254us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1782229036.806673:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 161 00000020:00080000:0.0:1782229036.806682:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229036.812177:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.812198:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.812206:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.812214:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229036.812219:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.812249:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.812272:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229036.812285:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229036.812292:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.812299:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64261 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229036.816107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229036.816219:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309563008 00000100:00100000:3.0:1782229036.816233:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309563008 00000100:00100000:3.0:1782229036.816323:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 162 00000100:00100000:3.0:1782229036.816335:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+50:11475:x1868802309563008:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229036.816368:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229036.816397:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e64268 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949980 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.816560:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.816586:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.816596:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.816640:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.816677:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 51 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229036.816694:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329485568:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229036.816801:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c5016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782229036.820490:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329485568:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229036.820532:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229036.825279:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229036.825690:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309563136 00000100:00100000:3.0:1782229036.825703:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309563136 00010000:00010000:3.0:1782229036.825759:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 52 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229036.825817:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:3.0:1782229036.825829:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:2372:x1868802309563136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229036.825849:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229036.825857:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 52 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.825874:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 52 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.825901:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64253 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949979 expref: 52 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.825945:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229036.825951:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.825962:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.825972:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229036.826016:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229036.826101:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+51:2372:x1868802309563136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 273us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229036.826110:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 69 00010000:00010000:0.0:1782229036.826492:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.826503:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229036.826567:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782229036.826582:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229036.826612:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.826668:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e64268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949980 expref: 51 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.826687:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949980 expref: 50 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.826696:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:0.0:1782229036.826699:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229036.826702:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916000, rc 0) 00000100:00100000:0.0:1782229036.826744:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+50:11475:x1868802309563008:12345-192.168.204.22@tcp:101:bash.0 Request processed in 10411us (10650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229036.826752:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 162 00000100:00100000:1.0:1782229036.835613:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229036.835728:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309563392 00000100:00100000:0.0:1782229036.835740:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309563392 00000100:00100000:0.0:1782229036.835819:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:0.0:1782229036.835832:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+50:11475:x1868802309563392:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:0.0:1782229036.836143:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+51:11475:x1868802309563392:12345-192.168.204.22@tcp:35:bash.0 Request processed in 313us (542us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1782229036.836152:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:2.0:1782229036.954370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229036.954877:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309563648 00000100:00100000:0.0:1782229036.954891:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309563648 00000100:00100000:0.0:1782229036.954961:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 163 00000100:00100000:0.0:1782229036.954973:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+51:11485:x1868802309563648:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229036.955288:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229036.955309:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949987 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229036.955474:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782229036.955609:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64276 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949987 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.955624:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:0.0:1782229036.955628:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782229036.955633:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949987 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229036.955649:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22a00, rc 0) 00000100:00100000:0.0:1782229036.955720:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11485:x1868802309563648:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 749us (1365us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1782229036.955728:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 163 00000100:00100000:2.0:1782229036.960881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229036.961084:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309563776 00000100:00100000:1.0:1782229036.961098:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309563776 00000100:00100000:1.0:1782229036.961223:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 164 00000100:00100000:1.0:1782229036.961235:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11485:x1868802309563776:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:1.0:1782229036.961348:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961369:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961383:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961402:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961426:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961476:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961623:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961632:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961639:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782229036.961706:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961728:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961736:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961744:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961751:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229036.961755:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961763:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961797:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229036.961800:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229036.961805:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961811:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961827:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961832:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961837:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961841:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229036.961844:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961850:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961856:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe439ad400) 00010000:00010000:1.0:1782229036.961859:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229036.961861:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961866:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e6428b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961889:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961896:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961901:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961906:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229036.961909:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961914:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961921:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229036.961924:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229036.961927:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229036.961933:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229036.962020:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11485:x1868802309563776:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 786us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229036.962029:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 164 00000100:00100000:1.0:1782229036.967864:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229036.967970:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309564032 00000100:00100000:0.0:1782229036.967983:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309564032 00000100:00100000:0.0:1782229036.968106:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:0.0:1782229036.968118:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11485:x1868802309564032:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229036.968925:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+53:11485:x1868802309564032:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 804us (1259us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1782229036.968935:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:2.0:1782229037.036162:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.036290:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309564288 00000100:00100000:1.0:1782229037.036303:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309564288 00000100:00100000:1.0:1782229037.036559:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 165 00000100:00100000:1.0:1782229037.036583:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+53:11488:x1868802309564288:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229037.036613:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229037.036639:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994998e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.036755:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.036782:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.036798:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.036817:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.036825:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.036832:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.036995:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e642ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037005:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e642ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037012:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e642ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229037.037036:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782229037.037162:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037171:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037178:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037186:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229037.037191:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037199:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037213:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229037.037217:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229037.037222:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037228:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037244:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037250:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037268:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037274:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229037.037278:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037290:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037299:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe439ad400) 00010000:00010000:1.0:1782229037.037301:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229037.037304:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037309:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037360:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994998e expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037376:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e642ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994998e expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.037383:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229037.037385:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229037.037388:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421e00, rc 0) 00000100:00100000:1.0:1782229037.037545:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+55:11488:x1868802309564288:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 966us (1399us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1782229037.037561:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 165 00000100:00080000:0.0:1782229037.038785:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229037.048345:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.048618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.048851:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309564544 00000100:00100000:0.0:1782229037.048874:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309564544 00000100:00100000:0.0:1782229037.048962:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:0.0:1782229037.048974:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+55:2371:x1868802309564544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229037.049017:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229037.049052:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e642ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994998e expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.049078:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:0.0:1782229037.049083:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229037.049173:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+54:2371:x1868802309564544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 201us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229037.049181:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:3.0:1782229037.049758:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309564416 00000100:00100000:3.0:1782229037.049776:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309564416 00000100:00100000:3.0:1782229037.049828:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 166 00000100:00100000:3.0:1782229037.049836:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+54:11488:x1868802309564416:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:3.0:1782229037.049927:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.049946:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.049960:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.049997:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.050013:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.050019:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.050025:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229037.050031:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.050039:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.050051:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229037.050054:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782229037.050058:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.050064:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229037.050139:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+54:11488:x1868802309564416:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 302us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229037.050148:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 166 00000100:00100000:2.0:1782229037.055016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229037.055195:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309564800 00000100:00100000:3.0:1782229037.055208:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309564800 00000100:00100000:3.0:1782229037.055361:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:3.0:1782229037.055375:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+54:11488:x1868802309564800:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229037.056202:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+55:11488:x1868802309564800:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 823us (1194us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1782229037.060476:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:0.0:1782229037.228595:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.228846:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309565056 00000100:00100000:1.0:1782229037.228855:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309565056 00000100:00100000:1.0:1782229037.229062:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 167 00000100:00100000:1.0:1782229037.229074:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+55:11506:x1868802309565056:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:1.0:1782229037.229101:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229037.229135:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949995 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.229250:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.229264:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.229276:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229037.229287:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782229037.229427:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949995 expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.229483:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949995 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.229491:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:1.0:1782229037.229494:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782229037.229498:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420400, rc 0) 00000100:00100000:1.0:1782229037.229588:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11506:x1868802309565056:12345-192.168.204.22@tcp:101:cat.0 Request processed in 516us (1003us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1782229037.229596:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 167 00000100:00100000:2.0:1782229037.256695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.256801:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309565184 00000100:00100000:1.0:1782229037.256810:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309565184 00000100:00100000:1.0:1782229037.257017:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 168 00000100:00100000:1.0:1782229037.257029:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11507:x1868802309565184:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229037.257054:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229037.257074:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f994999c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.257184:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e642df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.257199:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e642df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.257211:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e642df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229037.257272:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782229037.257276:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229037.257299:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e642df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.257325:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e642d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994999c expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.257344:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e642df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994999c expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.257366:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229037.257369:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782229037.257372:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420c00, rc 0) 00000100:00100000:1.0:1782229037.257489:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11507:x1868802309565184:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 463us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229037.257497:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 168 00000100:00100000:3.0:1782229037.271609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.271724:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309565568 00000100:00100000:0.0:1782229037.271737:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309565568 00000100:00100000:0.0:1782229037.271825:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:0.0:1782229037.271837:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11507:x1868802309565568:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229037.272302:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11507:x1868802309565568:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 466us (704us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1782229037.272312:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:0.0:1782229037.277117:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229037.277197:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309565696 00000100:00100000:3.0:1782229037.277207:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309565696 00000100:00100000:3.0:1782229037.277274:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:3.0:1782229037.277285:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11507:x1868802309565696:12345-192.168.204.22@tcp:103:lfs.0 00010000:00010000:3.0:1782229037.277301:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782229037.277325:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e6426f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949980 expref: 59 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.277347:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e642ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949995 expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.277359:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6417a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949941 expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.277370:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe43933b00) 00010000:00010000:3.0:1782229037.277380:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229037.277487:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+56:11507:x1868802309565696:12345-192.168.204.22@tcp:103:lfs.0 Request processed in 204us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229037.277496:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:1.0:1782229037.280662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.280776:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309565824 00000100:00100000:2.0:1782229037.280786:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309565824 00000100:00100000:2.0:1782229037.280854:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 169 00000100:00100000:2.0:1782229037.280980:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+56:11507:x1868802309565824:12345-192.168.204.22@tcp:58:lfs.0 00010000:00010000:2.0:1782229037.281089:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.281101:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.281110:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229037.281367:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1782229037.282312:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+56:11507:x1868802309565824:12345-192.168.204.22@tcp:58:lfs.0 Request processed in 1329us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229037.282322:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 169 00000100:00100000:2.0:1782229037.343119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229037.343328:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309565952 00000100:00100000:3.0:1782229037.343338:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309565952 00000100:00100000:3.0:1782229037.343413:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 170 00000100:00100000:3.0:1782229037.343425:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+56:11509:x1868802309565952:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229037.343496:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229037.343532:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e642ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499a3 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343614:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343628:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343640:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343654:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343662:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343668:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343837:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343848:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343855:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229037.343892:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782229037.343897:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229037.343916:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343935:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343945:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343952:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343958:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343965:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229037.343970:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343977:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.343990:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229037.343993:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229037.343998:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344004:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e642f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344017:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344023:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344035:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344040:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229037.344043:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344050:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344058:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe43933b00) 00010000:00010000:3.0:1782229037.344061:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229037.344064:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344070:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e642fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344101:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e642ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 58 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344114:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 57 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.344122:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:3.0:1782229037.344124:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782229037.344128:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917800, rc 0) 00000100:00100000:3.0:1782229037.344211:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11509:x1868802309565952:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 788us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229037.347414:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 170 00010000:00010000:3.0:1782229037.435808:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782229037.627818:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782229037.627834:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782229037.627918:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1782229037.627927:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782229037.628107:0:11549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329485696:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782229037.628254:0:11549:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782229037.631936:0:11549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329485696:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782229037.642790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.643377:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309566080 00000100:00100000:1.0:1782229037.643391:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309566080 00000100:00100000:0.0:1782229037.643878:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 171 00000100:00100000:0.0:1782229037.643897:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11520:x1868802309566080:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782229037.643944:0:5797:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782229037.644117:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11520:x1868802309566080:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 227us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229037.644124:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 171 00000100:00100000:2.0:1782229037.647781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.647907:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309566208 00000100:00100000:1.0:1782229037.647921:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309566208 00000100:00100000:1.0:1782229037.647996:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 172 00000100:00100000:1.0:1782229037.648008:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11520:x1868802309566208:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782229037.648110:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648132:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648147:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648659:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648683:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648696:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648756:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648765:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648772:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229037.648818:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782229037.648822:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229037.648835:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648849:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648855:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648861:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648867:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229037.648871:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648877:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648888:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:1.0:1782229037.648896:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229037.648902:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648907:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e64309 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648923:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648929:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648934:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648938:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229037.648941:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648946:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648952:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98fe439ad400) 00010000:00010000:1.0:1782229037.648955:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229037.648957:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648963:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64310 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648978:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648990:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.648996:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.649001:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229037.649004:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.649010:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.649018:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:1.0:1782229037.649020:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229037.649023:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.649028:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e64317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229037.649132:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11520:x1868802309566208:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 Request processed in 1122us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229037.649143:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 172 00000100:00100000:1.0:1782229037.661882:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.662109:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309566464 00000100:00100000:2.0:1782229037.662122:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309566464 00000100:00100000:2.0:1782229037.662212:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 173 00000100:00100000:2.0:1782229037.662226:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11520:x1868802309566464:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229037.662255:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229037.662299:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6431e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499aa expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662460:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662484:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662499:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229037.662515:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782229037.662659:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662667:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662675:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662681:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229037.662686:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662711:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662727:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:2.0:1782229037.662730:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229037.662735:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662742:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e64325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662799:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6431e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499aa expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662810:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:2.0:1782229037.662813:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229037.662817:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e6431e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499aa expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.662826:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcda00, rc 0) 00000100:00100000:2.0:1782229037.662901:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11520:x1868802309566464:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 679us (1034us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1782229037.662909:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 173 00000100:00100000:2.0:1782229037.668691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.672701:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309566592 00000100:00100000:1.0:1782229037.672717:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309566592 00000100:00100000:1.0:1782229037.672792:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 174 00000100:00100000:1.0:1782229037.672803:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11520:x1868802309566592:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782229037.672859:0:5798:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782229037.672984:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11520:x1868802309566592:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 182us (4308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229037.672992:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 174 00000100:00100000:1.0:1782229037.677624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.679676:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309566848 00000100:00100000:2.0:1782229037.679691:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309566848 00000100:00100000:2.0:1782229037.679820:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 175 00000100:00100000:2.0:1782229037.679832:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11520:x1868802309566848:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229037.679864:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229037.679868:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782229037.679896:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e642df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994999c expref: 58 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.679916:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:2.0:1782229037.679921:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229037.679935:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64333 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499b1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782229037.683848:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1782229037.684100:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e6433a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.684120:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e6433a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.684132:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e6433a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.684219:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64333 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b1 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.684862:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e6433a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b1 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.684873:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58dddc00) 00010000:00010000:2.0:1782229037.684876:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229037.684894:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc200, rc 0) 00000100:00100000:2.0:1782229037.684971:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11520:x1868802309566848:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 5141us (7357us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1782229037.684981:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 175 00000100:00100000:2.0:1782229037.701241:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229037.702705:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309567104 00000100:00100000:3.0:1782229037.702723:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309567104 00000100:00100000:3.0:1782229037.702822:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 176 00000100:00100000:3.0:1782229037.702835:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11520:x1868802309567104:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782229037.702922:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229037.702959:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e6433a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b1 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.702986:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58dddc00) 00010000:00010000:3.0:1782229037.703001:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229037.703030:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703047:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703059:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703077:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703084:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703091:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703224:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703233:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703240:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703247:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229037.703252:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703273:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703282:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229037.703285:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229037.703289:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703296:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64348 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703306:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703313:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703320:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703332:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229037.703336:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703343:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703352:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa7990348 (ffff98fe43933b00) 00010000:00010000:3.0:1782229037.703355:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229037.703358:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.703364:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6434f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa7990348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229037.703549:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11520:x1868802309567104:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 715us (2317us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782229037.703568:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 176 00000100:00100000:1.0:1782229037.712206:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.712320:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309567232 00000100:00100000:2.0:1782229037.712334:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309567232 00000100:00100000:2.0:1782229037.712416:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 177 00000100:00100000:2.0:1782229037.712476:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11520:x1868802309567232:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229037.712498:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229037.712525:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64356 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499b8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.712571:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.712584:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.712596:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.712709:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e64356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.712729:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.712736:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:2.0:1782229037.712745:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782229037.712748:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcdc00, rc 0) 00000100:00100000:2.0:1782229037.712818:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11520:x1868802309567232:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 393us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229037.712825:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 177 00000100:00100000:0.0:1782229037.721053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.721601:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309567488 00000100:00100000:2.0:1782229037.721611:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309567488 00000100:00100000:2.0:1782229037.721673:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 178 00000100:00100000:2.0:1782229037.721683:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11520:x1868802309567488:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782229037.721935:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.721953:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.721965:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229037.722404:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1782229037.722416:0:10359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350718985048ns, next at 351718982839ns, rc = 0 00000004:00010000:2.0:1782229037.722548:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a9d6eea reply state 000000007d116263 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229037.722567:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782229037.722663:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11520:x1868802309567488:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 979us (1618us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1782229037.722671:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 178 00010000:00010000:1.0:1782229037.727163:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.727184:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.727192:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.727198:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229037.727204:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.727212:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.727232:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:1.0:1782229037.727235:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782229037.727239:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.727245:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e64364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229037.740270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.740415:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309567616 00000100:00100000:0.0:1782229037.740425:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309567616 00000100:00100000:0.0:1782229037.740540:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 179 00000100:00100000:0.0:1782229037.740560:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11520:x1868802309567616:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229037.740583:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229037.740633:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499bf expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.740711:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.740727:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.740749:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:0.0:1782229037.740752:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229037.740756:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22c00, rc 0) 00000100:00100000:0.0:1782229037.740815:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11520:x1868802309567616:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 267us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229037.740832:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 179 00000100:00100000:1.0:1782229037.744883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.745169:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309567744 00000100:00100000:0.0:1782229037.745179:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309567744 00000100:00100000:0.0:1782229037.745458:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:0.0:1782229037.745480:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+6:2373:x1868802309567744:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782229037.745872:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309567744:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 403us (995us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1782229037.745880:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:1.0:1782229037.756335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.759919:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309568000 00000100:00100000:2.0:1782229037.759938:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309568000 00000100:00100000:2.0:1782229037.760705:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:2.0:1782229037.760718:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11520:x1868802309568000:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782229037.761680:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11520:x1868802309568000:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 962us (5352us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1782229037.761699:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:2.0:1782229037.768953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.769281:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309568256 00000100:00100000:1.0:1782229037.769292:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309568256 00000100:00100000:1.0:1782229037.769575:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 180 00000100:00100000:1.0:1782229037.769587:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11520:x1868802309568256:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782229037.770212:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11520:x1868802309568256:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 624us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229037.770221:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 180 00000100:00100000:1.0:1782229037.780631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.780827:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309568384 00000100:00100000:0.0:1782229037.780836:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309568384 00000100:00100000:0.0:1782229037.782485:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 181 00000100:00100000:0.0:1782229037.782501:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11520:x1868802309568384:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229037.782523:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229037.782544:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e64372 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499c6 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.782626:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e64379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.782639:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e64379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.782650:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e64379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229037.782688:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229037.782707:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e64379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.782741:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22600/0x8e1c8a3488e64372 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499c6 expref: 64 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.782756:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e64379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499c6 expref: 63 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.782765:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:0.0:1782229037.782768:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782229037.782771:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23600, rc 0) 00000100:00100000:0.0:1782229037.782838:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+63:11520:x1868802309568384:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 343us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229037.782846:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 181 00000100:00100000:0.0:1782229037.803651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229037.806227:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309568512 00000100:00100000:1.0:1782229037.806241:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309568512 00000100:00100000:1.0:1782229037.806335:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:1.0:1782229037.806346:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2371:x1868802309568512:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229037.806364:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229037.806396:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499cd expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782229037.806422:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3aa82e, blocks: 0x1 00010000:00010000:1.0:1782229037.806473:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1782229037.806478:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229037.806488:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.806505:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.806533:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421e00, rc 0) 00000100:00100000:1.0:1782229037.806606:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2371:x1868802309568512:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 262us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229037.806614:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:2.0:1782229037.813186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.814867:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309568768 00000100:00100000:0.0:1782229037.814879:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309568768 00000100:00100000:0.0:1782229037.814933:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 182 00000100:00100000:0.0:1782229037.814944:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+63:11520:x1868802309568768:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782229037.815211:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+63:11520:x1868802309568768:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 268us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229037.815219:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 182 00000100:00100000:0.0:1782229037.825094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.825128:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309568896 00000100:00100000:0.0:1782229037.825137:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309568896 00000100:00100000:0.0:1782229037.825185:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:0.0:1782229037.825195:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+8:11520:x1868802309568896:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229037.825226:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229037.825243:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499d4 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.825275:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.825286:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229037.825290:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229037.825295:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 9 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.825331:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 9 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.825346:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 9 pid: 6598 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229037.825360:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1868802329485824:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229037.825486:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68e929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229037.834135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229037.834609:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1868802329485824:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229037.834642:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 9 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.834664:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22600, rc 0) 00000100:00100000:2.0:1782229037.834729:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+9:11520:x1868802309568896:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 9535us (9645us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229037.834739:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:3.0:1782229037.842089:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309569024 00000100:00100000:3.0:1782229037.842103:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309569024 00010000:00010000:3.0:1782229037.842147:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 9 pid: 6598 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229037.842211:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:3.0:1782229037.842221:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2373:x1868802309569024:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229037.842235:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229037.842258:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 9 pid: 6598 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.842287:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 9 pid: 6598 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.842326:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff6feb8a/0x8e1c8a3488e64380 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499cd expref: 9 pid: 6598 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.842340:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229037.842344:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229037.842352:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.842363:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229037.842415:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229037.842449:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5782:1868802329485952:192.168.204.22@tcp:105: 00000100:00100000:3.0:1782229037.842664:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5b8e4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782229037.857810:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5782:1868802329485952:192.168.204.22@tcp:105: 00010000:00010000:3.0:1782229037.857841:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229037.857894:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309569024:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 15674us (23769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229037.857906:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:3.0:1782229037.867244:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.867918:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309569152 00000100:00100000:0.0:1782229037.867928:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309569152 00002000:00100000:0.0:1782229037.868049:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98fe77c08380 x1868802309569152/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:208/0 lens 504/0 e 0 to 0 dl 1782229048 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782229037.868061:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe77c08380 with x1868802309569152 ext(0->8) 00002000:00010000:0.0:1782229037.868074:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe77c08380 00000100:00100000:0.0:1782229037.868110:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:0.0:1782229037.868119:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309569152:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782229037.870108:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2373:x1868802309569152:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 Request processed in 1983us (2868us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782229037.870119:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 4 00002000:00100000:0.0:1782229037.870129:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98fe77c08380 x1868802309569152/t4294967314(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:208/0 lens 504/448 e 0 to 0 dl 1782229048 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782229037.870139:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe77c08380 with x1868802309569152 ext(0->8) 00002000:00010000:0.0:1782229037.870144:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe77c08380 00000100:00100000:3.0:1782229037.881483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.881670:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309569280 00000100:00100000:0.0:1782229037.881680:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309569280 00000100:00100000:0.0:1782229037.881735:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 183 00000100:00100000:0.0:1782229037.881746:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+63:11520:x1868802309569280:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1782229037.939903:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+63:11520:x1868802309569280:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 Request processed in 58147us (58427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229037.939917:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 183 00000001:00080000:3.0:1782229037.939975:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:3.0:1782229037.940021:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1782229037.940028:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1782229037.940057:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1782229037.940152:0:5818:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe6c5019c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1782229037.940157:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe77c7bc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe6c501600 00000020:00080000:3.0:1782229037.940161:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe77c7be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fe77b7dc00 00000020:00080000:3.0:1782229037.940284:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1782229037.940312:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329486080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782229037.940368:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229037.940375:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782229037.940389:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329486208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782229037.940450:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329486080 00000100:00100000:1.0:1782229037.940453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229037.940458:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329486080 00000020:00080000:3.0:1782229037.940509:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1782229037.940512:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329486208 00000100:00100000:0.0:1782229037.940516:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329486208 00000100:00080000:2.0:1782229037.940520:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782229037.940527:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229037.940545:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782229037.940566:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329486080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782229037.940618:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782229037.940626:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329486208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782229037.940642:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1782229037.940668:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3aa82b, atime: 0x6a3aa82b, ctime: 0x6a3aa82b, blocks: 0x1 00010000:00010000:1.0:1782229037.940675:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.940687:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1782229037.940691:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229037.940695:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.940707:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782229037.940708:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782229037.940715:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782229038 00002000:00010000:0.0:1782229037.940719:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782229037.940732:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782229038 -> 1782229038 00002000:00010000:0.0:1782229037.940735:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1782229037.940738:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.940755:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229037.940773:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782229037.940783:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329486080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (414us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1782229037.940790:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1782229037.941132:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229037.941140:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.941150:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229037.941155:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.941178:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.941197:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229037.941199:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1868802329486208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 572us (767us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782229037.941215:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1782229037.941271:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe77c09880/2, rc 0, transno 4294967307 00000100:00100000:3.0:1782229037.941277:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329486208:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782229037.941583:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265bbe5a/0x8e1c8a3488e6438e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229037.941604:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229037.941606:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229037.941608:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782229037.941628:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fd42a7d500/2, rc 0, transno 4294967315 00000100:00100000:2.0:1782229037.941633:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329486080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782229037.948713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.948915:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309569408 00000100:00100000:0.0:1782229037.948933:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309569408 00000100:00100000:0.0:1782229037.949050:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:0.0:1782229037.949071:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2373:x1868802309569408:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1782229037.979003:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1782229037.979019:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1782229037.979171:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309569408:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 Request processed in 30103us (30491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229037.979184:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:3.0:1782229037.986063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.986155:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309569664 00000100:00100000:0.0:1782229037.986165:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309569664 00000100:00100000:0.0:1782229037.986225:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 184 00000100:00100000:0.0:1782229037.986235:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11520:x1868802309569664:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782229037.986289:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229037.986318:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e64379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499c6 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.986339:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:0.0:1782229037.986345:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229037.986377:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.986392:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.986402:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229037.986707:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbf6a3a7 reply state 00000000cf28a854 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229037.986728:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229037.986841:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+19:11520:x1868802309569664:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 607us (786us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1782229037.986849:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 184 00010000:00010000:0.0:1782229037.989375:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.989391:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.989399:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.989406:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229037.989412:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.989420:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.989449:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:0.0:1782229037.989453:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229037.989458:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.989465:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64395 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229037.992359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.993008:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309569792 00000100:00100000:0.0:1782229037.993019:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309569792 00000100:00100000:0.0:1782229037.993079:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:0.0:1782229037.993088:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309569792:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782229037.993350:0:8488:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782229037.993354:0:8488:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782229038 -> 1782229037 00002000:00010000:0.0:1782229037.993357:0:8488:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782229035 00002000:00010000:0.0:1782229037.993359:0:8488:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782229038 -> 1782229037 00002000:00010000:0.0:1782229037.993361:0:8488:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782229037.993824:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309569792:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 734us (1470us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782229037.993833:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:3.0:1782229037.997487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229037.997590:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309570048 00000100:00100000:0.0:1782229037.997600:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309570048 00000100:00100000:0.0:1782229037.997658:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 185 00000100:00100000:0.0:1782229037.997667:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11520:x1868802309570048:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782229037.997748:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.997775:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.997783:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.997815:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229037.997831:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 18 pid: 5796 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229037.997853:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329486336:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229037.997923:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44667780 going to sleep for 11 seconds 00000100:00100000:3.0:1782229038.000714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.000714:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329486336:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229038.000740:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.000895:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309570176 00000100:00100000:1.0:1782229038.000902:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309570176 00010000:00010000:1.0:1782229038.000934:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 19 pid: 5796 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.000967:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 71 00000100:00100000:1.0:1782229038.000974:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+19:2371:x1868802309570176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229038.000986:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229038.000991:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 19 pid: 5796 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.001001:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 19 pid: 5796 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.001026:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e6435d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499b8 expref: 19 pid: 5796 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.001036:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:1.0:1782229038.001039:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.001045:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.001050:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.001067:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229038.001106:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.001113:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.001115:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2371:x1868802309570176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.001122:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 71 00010000:00010000:3.0:1782229038.001142:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.001149:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.001161:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.001167:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229038.001171:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.001179:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.001189:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:3.0:1782229038.001191:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782229038.001195:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.001201:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e6439c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229038.001256:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+17:11520:x1868802309570048:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 Request processed in 3590us (3779us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782229038.001264:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 185 00000100:00100000:3.0:1782229038.010715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.011864:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309570304 00000100:00100000:1.0:1782229038.011875:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309570304 00000100:00100000:1.0:1782229038.011941:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:1.0:1782229038.011951:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2372:x1868802309570304:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782229038.011993:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.012013:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.012034:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782229038.012038:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229038.012043:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.012079:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.012095:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 8 pid: 8488 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.012109:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1868802329486464:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229038.012183:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e840 going to sleep for 11 seconds 00000100:00080000:2.0:1782229038.012300:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782229038.018694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.018740:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309570432 00000100:00100000:0.0:1782229038.018750:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309570432 00010000:00010000:0.0:1782229038.018791:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 9 pid: 8488 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.018877:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 72 00000100:00100000:0.0:1782229038.018888:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2373:x1868802309570432:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229038.018903:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229038.018924:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 9 pid: 8488 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.018939:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 9 pid: 8488 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.018965:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782229038.018969:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782229038.018976:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.019001:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.019022:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229038.019068:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2373:x1868802309570432:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 182us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229038.019075:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 72 00010000:00010000:1.0:1782229038.019174:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7da016f/0x8e1c8a3488e64387 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499d4 expref: 8 pid: 8488 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.019187:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1868802329486464:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229038.019208:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019218:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019226:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019253:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019262:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019270:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019277:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229038.019281:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019290:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019301:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.019509:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e643a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.020238:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309570304:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 Request processed in 8285us (9528us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.020247:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:0.0:1782229038.023070:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229038.023157:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309570688 00000100:00100000:2.0:1782229038.023166:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309570688 00000100:00100000:2.0:1782229038.023249:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 186 00000100:00100000:2.0:1782229038.023259:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+17:11520:x1868802309570688:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782229038.023337:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.023353:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.023375:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.023788:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.023801:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.023810:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.023843:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.023859:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 18 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229038.023873:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329486592:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229038.023994:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe47c68600 going to sleep for 11 seconds 00000100:00100000:2.0:1782229038.028347:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.028659:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329486592:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229038.028688:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229038.029077:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309570816 00000100:00100000:3.0:1782229038.029085:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309570816 00010000:00010000:2.0:1782229038.029201:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229038.029277:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 73 00000100:00100000:2.0:1782229038.029287:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+19:2373:x1868802309570816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229038.029301:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229038.029321:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.029336:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.029358:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e6436b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499bf expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.029372:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:2.0:1782229038.029377:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.029385:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.029392:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.029423:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229038.029496:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2373:x1868802309570816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 210us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229038.029503:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 73 00010000:00010000:3.0:1782229038.029567:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.029575:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782229038.029809:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1782229038.029958:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1782229038.030003:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1782229038.030087:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10359:1868802329486720:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782229038.030193:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229038.030220:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782229038.031404:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329486720 00000100:00100000:1.0:1782229038.031413:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329486720 00000100:00100000:1.0:1782229038.031468:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782229038.031477:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10359:x1868802329486720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782229038.031590:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10359:x1868802329486720:12345-0@lo:1000:mdt00_003.0 Request processed in 114us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.031596:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782229038.031637:0:10359:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1782229038.031642:0:10359:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fd42a7d500, transno 4294967315 00000100:00100000:1.0:1782229038.031655:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10359:1868802329486720:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1782229038.032149:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1782229038.032234:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10359:1868802329486848:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782229038.032269:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229038.032289:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe7bc3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229038.032488:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329486848 00000100:00100000:1.0:1782229038.032493:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329486848 00000100:00100000:1.0:1782229038.032517:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782229038.032524:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10359:x1868802329486848:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782229038.032692:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10359:x1868802329486848:12345-0@lo:1000:mdt00_003.0 Request processed in 168us (421us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1782229038.032699:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782229038.032732:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10359:1868802329486848:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1782229038.032763:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032771:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032789:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032795:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.032800:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032808:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032823:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe58ddd800) 00010000:00010000:1.0:1782229038.032827:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229038.032832:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032837:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e643b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032864:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032871:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032877:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032881:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.032884:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032899:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032907:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:1.0:1782229038.032909:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229038.032912:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032918:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e642e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032939:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032953:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 21 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032961:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032983:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 21 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.032999:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 21 pid: 10359 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.033010:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329486976:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229038.033073:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb80480 going to sleep for 11 seconds 00000100:00100000:2.0:1782229038.039898:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329486976:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229038.039924:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229038.040922:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.041094:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309570944 00000100:00100000:0.0:1782229038.041101:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309570944 00010000:00010000:0.0:1782229038.041137:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 22 pid: 10359 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.041217:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 74 00000100:00100000:0.0:1782229038.041227:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+22:2373:x1868802309570944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229038.041240:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229038.041247:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 22 pid: 10359 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.041262:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 22 pid: 10359 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.041296:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499a3 expref: 22 pid: 10359 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.041311:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:0.0:1782229038.041316:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.041324:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.041331:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.041358:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229038.041405:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+21:2373:x1868802309570944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 179us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229038.041413:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 74 00010000:00010000:2.0:1782229038.044898:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044925:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044940:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044946:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044953:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044959:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229038.044964:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044972:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044986:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:2.0:1782229038.044989:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229038.044992:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.044997:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420a00/0x8e1c8a3488e643b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.045009:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.045015:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.045026:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.045031:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229038.045034:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.045072:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.045081:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:2.0:1782229038.045083:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782229038.045086:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.045091:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e643aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229038.045332:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+20:11520:x1868802309570688:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 22071us (22265us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1782229038.045342:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 186 00000020:00080000:2.0:1782229038.045348:0:10359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782229038.045477:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782229038.045481:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782229038.045781:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782229038.045788:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782229038.049540:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.049969:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309571200 00000100:00100000:0.0:1782229038.049981:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309571200 00000100:00100000:0.0:1782229038.050069:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:0.0:1782229038.050080:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42f0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+20:11520:x1868802309571200:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782229038.050768:0:5800:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782229038.050873:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1782229038.050920:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.050937:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.050961:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.050970:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.050979:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.050986:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.051012:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782229038.051109:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42f0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+22:11520:x1868802309571200:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 1029us (1576us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1782229038.051118:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 50 00000020:00080000:0.0:1782229038.051124:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229038.051211:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229038.051218:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.051225:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229038.051229:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.051237:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.051250:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98fe42cb9e00) 00010000:00010000:3.0:1782229038.051254:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782229038.051259:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.051265:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e643bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.051280:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229038.051282:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229038.051284:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782229038.147708:0:12330:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782229038.147724:0:12330:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782229038.147766:0:12330:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1782229038.147772:0:12330:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229038.285885:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.290647:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309571456 00000100:00100000:1.0:1782229038.290662:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309571456 00000100:00100000:0.0:1782229038.291062:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 187 00000100:00100000:0.0:1782229038.291074:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:11530:x1868802309571456:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229038.291100:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229038.294025:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e643c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499db expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.294317:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e643cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.294333:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e643cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.294357:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e643cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229038.294370:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1782229038.294720:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e643c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499db expref: 25 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.294738:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e643cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499db expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.294747:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229038.294750:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782229038.294753:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23200, rc 0) 00000100:00100000:0.0:1782229038.295309:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+24:11530:x1868802309571456:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 4234us (9428us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1782229038.295318:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 187 00000100:00100000:2.0:1782229038.300930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.301342:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309571584 00000100:00100000:0.0:1782229038.301351:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309571584 00000100:00100000:0.0:1782229038.301712:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 188 00000100:00100000:0.0:1782229038.301723:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+24:11530:x1868802309571584:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:0.0:1782229038.301793:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.301808:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.301818:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.301854:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.301861:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.301869:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302146:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302153:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302160:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229038.302209:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302221:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302227:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302233:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302238:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.302242:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302254:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302265:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229038.302268:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.302272:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302277:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e643db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302288:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302293:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302299:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302303:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.302306:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302311:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302317:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe42cb9300) 00010000:00010000:0.0:1782229038.302319:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.302321:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302332:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e643e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302345:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302350:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302356:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302360:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.302363:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302367:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302375:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe42cb9c00) 00010000:00010000:0.0:1782229038.302377:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.302379:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.302384:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e643e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.302616:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+24:11530:x1868802309571584:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 893us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229038.302625:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 188 00000100:00100000:0.0:1782229038.367008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.367584:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309571840 00000100:00100000:1.0:1782229038.367594:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309571840 00000100:00100000:1.0:1782229038.367708:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 189 00000100:00100000:1.0:1782229038.367719:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+24:11533:x1868802309571840:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229038.367740:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229038.367763:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e643f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499e2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.367850:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.367865:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.367876:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.367889:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.367896:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.367902:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368230:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368244:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368251:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229038.368262:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782229038.368352:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368359:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368365:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368370:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.368374:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368392:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368403:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229038.368407:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229038.368410:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368416:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e643f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368497:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368511:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368517:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368523:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.368526:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368532:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368550:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe439ad400) 00010000:00010000:1.0:1782229038.368553:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229038.368555:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368560:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421c00/0x8e1c8a3488e643fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368599:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e643f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 27 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368611:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.368619:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:1.0:1782229038.368621:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229038.368629:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421400, rc 0) 00000100:00100000:1.0:1782229038.368681:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11533:x1868802309571840:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 964us (1684us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1782229038.368690:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 189 00000100:00100000:2.0:1782229038.380472:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.380621:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309571968 00000100:00100000:1.0:1782229038.380630:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309571968 00000100:00100000:1.0:1782229038.380677:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 190 00000100:00100000:1.0:1782229038.380688:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11533:x1868802309571968:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:1.0:1782229038.380758:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380775:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380786:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380814:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380821:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380828:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380834:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.380838:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380845:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380865:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:1.0:1782229038.380868:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229038.380873:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.380879:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.380954:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11533:x1868802309571968:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 267us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.380962:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 190 00000100:00100000:2.0:1782229038.383692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.383811:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309572224 00000100:00100000:0.0:1782229038.383819:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309572224 00000100:00100000:0.0:1782229038.383899:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:0.0:1782229038.383908:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11533:x1868802309572224:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229038.384137:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+27:11533:x1868802309572224:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 230us (454us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1782229038.384145:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:3.0:1782229038.437595:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.437840:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309572480 00000100:00100000:0.0:1782229038.437850:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309572480 00000100:00100000:0.0:1782229038.437979:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 191 00000100:00100000:0.0:1782229038.437991:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+27:11068:x1868802309572480:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229038.438014:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229038.438037:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e6441a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499e9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.438140:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.438154:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 28 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.438163:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.438196:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 28 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.438228:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 28 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.438243:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329487104:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229038.438331:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9840 going to sleep for 11 seconds 00000100:00100000:0.0:1782229038.454278:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329487104:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229038.454311:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.461342:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229038.463644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.464060:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309572608 00000100:00100000:0.0:1782229038.464080:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309572608 00010000:00010000:0.0:1782229038.464123:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 29 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.464165:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 75 00000100:00100000:0.0:1782229038.464174:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+29:2373:x1868802309572608:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229038.464190:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229038.464197:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 29 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.464213:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 29 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.464234:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421400/0x8e1c8a3488e64405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e2 expref: 29 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.464271:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:0.0:1782229038.464277:0:11530:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.464287:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.464295:0:11530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.464333:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229038.464388:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+28:2373:x1868802309572608:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 214us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229038.464396:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 75 00010000:00010000:1.0:1782229038.465675:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.465693:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229038.465715:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782229038.465892:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e6441a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.465911:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.465919:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:1.0:1782229038.465922:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782229038.465925:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22e00, rc 0) 00000100:00100000:1.0:1782229038.465968:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+28:11068:x1868802309572480:12345-192.168.204.22@tcp:101:bash.0 Request processed in 27980us (28385us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1782229038.465988:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 191 00000100:00100000:2.0:1782229038.480629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.480843:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309572864 00000100:00100000:1.0:1782229038.480852:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309572864 00000100:00100000:1.0:1782229038.480914:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 192 00000100:00100000:1.0:1782229038.480925:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+28:11068:x1868802309572864:12345-192.168.204.22@tcp:36:bash.0 00010000:00010000:1.0:1782229038.481214:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.481230:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.481240:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782229038.481295:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1782229038.481319:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b664d76 reply state 000000001f2adc82 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.481327:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1782229038.481378:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1782229038.487355:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+32:11068:x1868802309572864:12345-192.168.204.22@tcp:36:bash.0 Request processed in 6419us (6724us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1782229038.487370:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 192 00000020:00080000:2.0:1782229038.487378:0:10359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1782229038.498610:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.498630:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.498638:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.498645:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.498669:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.498678:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.498697:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:1.0:1782229038.498701:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229038.498707:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.498714:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e6442f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229038.505779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.505843:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309572992 00000100:00100000:1.0:1782229038.505856:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309572992 00000100:00100000:1.0:1782229038.506028:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 193 00000100:00100000:1.0:1782229038.506040:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+31:11068:x1868802309572992:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229038.506062:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229038.506084:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499f0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.506152:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f0 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.506167:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f0 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.506187:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:1.0:1782229038.506191:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229038.506207:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421000, rc 0) 00000100:00100000:1.0:1782229038.506270:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+32:11068:x1868802309572992:12345-192.168.204.22@tcp:101:bash.0 Request processed in 233us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.506277:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 193 00000100:00100000:3.0:1782229038.510302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.511192:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309573120 00000100:00100000:1.0:1782229038.511204:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309573120 00000100:00100000:1.0:1782229038.511270:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:1.0:1782229038.511280:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:11068:x1868802309573120:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229038.511298:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229038.511319:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499f7 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782229038.511346:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3aa82d, atime: 0x6a3aa82b, ctime: 0x6a3aa82d, blocks: 0xb 00010000:00010000:1.0:1782229038.511369:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1782229038.511374:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229038.511383:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.511400:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.511413:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421c00, rc 0) 00000100:00100000:1.0:1782229038.511511:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:11068:x1868802309573120:12345-192.168.204.22@tcp:101:bash.0 Request processed in 232us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.511518:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:3.0:1782229038.515249:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.516803:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309573248 00000100:00100000:0.0:1782229038.516816:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309573248 00002000:00010000:0.0:1782229038.516862:0:6605:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1782229038.516867:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe50dc3800 with x1868802309573248 ext(0->18446744073709551615) 00002000:00010000:0.0:1782229038.516879:0:6605:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe50dc3800. 00000100:00100000:0.0:1782229038.516913:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:0.0:1782229038.516922:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309573248:12345-192.168.204.22@tcp:10:bash.0 00002000:00010000:0.0:1782229038.517215:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1782229038.517219:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782229037 -> 1782229038 00002000:00010000:0.0:1782229038.517223:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1782229035 -> 1782229035 00002000:00010000:0.0:1782229038.517225:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782229037 -> 1782229038 00002000:00010000:0.0:1782229038.517228:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1782229038.517309:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2373:x1868802309573248:12345-192.168.204.22@tcp:10:bash.0 Request processed in 386us (2069us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1782229038.517316:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 5 00002000:00010000:0.0:1782229038.517320:0:6605:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1782229038.517323:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe50dc3800 with x1868802309573248 ext(0->18446744073709551615) 00002000:00010000:0.0:1782229038.517327:0:6605:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe50dc3800. 00000100:00100000:2.0:1782229038.662011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.662221:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309573376 00000100:00100000:0.0:1782229038.662231:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309573376 00000100:00100000:0.0:1782229038.662297:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 194 00000100:00100000:0.0:1782229038.662307:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+32:11547:x1868802309573376:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:0.0:1782229038.662386:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662403:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662414:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662455:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662462:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662468:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662774:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662796:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662803:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229038.662847:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662858:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662865:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662871:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662877:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.662881:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662888:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662901:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229038.662904:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.662909:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662914:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662934:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662941:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662948:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662952:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.662955:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662960:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662967:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe42cb9c00) 00010000:00010000:0.0:1782229038.662970:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.662972:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662978:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e6444b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662992:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.662997:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.663003:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.663014:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.663017:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.663023:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.663032:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:0.0:1782229038.663034:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.663037:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.663043:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.663308:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+32:11547:x1868802309573376:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 999us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229038.663318:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 194 00000100:00100000:3.0:1782229038.717828:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.717999:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309573632 00000100:00100000:0.0:1782229038.718008:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309573632 00000100:00100000:0.0:1782229038.718066:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 195 00000100:00100000:0.0:1782229038.718076:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+32:11550:x1868802309573632:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229038.718096:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229038.718115:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f99499fe expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718184:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718332:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718346:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718360:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718367:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718374:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718725:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6446e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718735:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6446e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718743:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6446e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229038.718752:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782229038.718839:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718847:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718854:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.718866:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.718871:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720087:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720106:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229038.720109:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.720114:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720119:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720134:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720141:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720146:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720151:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.720154:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720158:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720178:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe42cb9c00) 00010000:00010000:0.0:1782229038.720180:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.720183:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720189:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720622:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499fe expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720637:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6446e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499fe expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.720644:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:0.0:1782229038.720646:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782229038.720648:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23800, rc 0) 00000100:00100000:0.0:1782229038.720743:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11550:x1868802309573632:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 2666us (2922us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782229038.720752:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 195 00000100:00100000:3.0:1782229038.731136:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.731256:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309573760 00000100:00100000:1.0:1782229038.731278:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309573760 00000100:00100000:1.0:1782229038.731342:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 196 00000100:00100000:1.0:1782229038.731353:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11550:x1868802309573760:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:1.0:1782229038.731473:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.731491:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.731500:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.731545:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.731560:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 34 pid: 5796 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.731574:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329487232:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229038.732005:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb80a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782229038.734907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.735011:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309574016 00000100:00100000:0.0:1782229038.735019:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309574016 00000100:00100000:0.0:1782229038.735084:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:0.0:1782229038.735094:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+35:9962:x1868802309574016:12345-192.168.204.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782229038.735495:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+36:9962:x1868802309574016:12345-192.168.204.22@tcp:35:ldlm_bl.0 Request processed in 398us (592us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1782229038.735520:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:1.0:1782229038.735854:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329487232:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229038.735879:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229038.739843:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.739934:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309574144 00000100:00100000:0.0:1782229038.739944:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309574144 00010000:00010000:0.0:1782229038.740164:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 36 pid: 5796 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.740219:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 76 00000100:00100000:0.0:1782229038.740230:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+36:2372:x1868802309574144:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229038.740245:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229038.740253:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 36 pid: 5796 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.740268:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 36 pid: 5796 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.740289:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64421 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499e9 expref: 36 pid: 5796 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.740306:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:0.0:1782229038.740311:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.740320:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.740329:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.740627:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.740700:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.741248:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229038.741315:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503fa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+35:2372:x1868802309574144:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 1085us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229038.741336:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 76 00010000:00010000:1.0:1782229038.741452:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.741461:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.741467:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.741473:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.741477:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.741485:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.741496:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:1.0:1782229038.741499:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229038.741503:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.741508:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e6447c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.741564:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11550:x1868802309573760:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 10214us (10437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.741573:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 196 00000100:00100000:3.0:1782229038.752571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.752820:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309574400 00000100:00100000:0.0:1782229038.752829:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309574400 00000100:00100000:0.0:1782229038.753032:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:0.0:1782229038.753042:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+34:11550:x1868802309574400:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229038.753243:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+35:11550:x1868802309574400:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 202us (682us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1782229038.753252:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:3.0:1782229038.839045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.839418:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309574656 00000100:00100000:1.0:1782229038.839456:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309574656 00000100:00100000:1.0:1782229038.839520:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 197 00000100:00100000:1.0:1782229038.839557:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+35:11561:x1868802309574656:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:1.0:1782229038.839587:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229038.839611:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64483 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a05 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.839692:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.839707:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.839717:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.839807:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.839817:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.839824:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840349:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840360:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840367:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229038.840389:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1782229038.840510:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840519:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840526:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840546:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.840550:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840557:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840569:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229038.840572:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229038.840576:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840581:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421e00/0x8e1c8a3488e6448a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840592:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840599:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840615:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840620:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.840623:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840629:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840637:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe439ad800) 00010000:00010000:1.0:1782229038.840639:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229038.840642:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840646:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840689:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421200/0x8e1c8a3488e64483 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a05 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840703:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a05 expref: 37 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.840710:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:1.0:1782229038.840712:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229038.840715:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420200, rc 0) 00000100:00100000:1.0:1782229038.842108:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+37:11561:x1868802309574656:12345-192.168.204.22@tcp:101:cat.0 Request processed in 2546us (3063us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1782229038.842135:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 197 00000100:00100000:3.0:1782229038.855517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229038.856104:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309574912 00000100:00100000:2.0:1782229038.856115:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309574912 00000100:00100000:2.0:1782229038.856185:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 54 00000100:00100000:2.0:1782229038.856195:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+37:11561:x1868802309574912:12345-192.168.204.22@tcp:35:cat.0 00000100:00100000:2.0:1782229038.856716:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+38:11561:x1868802309574912:12345-192.168.204.22@tcp:35:cat.0 Request processed in 471us (1160us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1782229038.856726:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 54 00000100:00100000:3.0:1782229038.904097:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229038.904408:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309575168 00000100:00100000:2.0:1782229038.904418:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309575168 00000100:00100000:2.0:1782229038.904982:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 198 00000100:00100000:2.0:1782229038.904994:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+38:11562:x1868802309575168:12345-192.168.204.22@tcp:36:rm.0 00010000:00010000:2.0:1782229038.905053:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782229038.905081:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420200/0x8e1c8a3488e64498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a05 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905105:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6446e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499fe expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905120:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421000/0x8e1c8a3488e64436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f0 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905145:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe439ad200) 00010000:00010000:2.0:1782229038.905169:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229038.905192:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905217:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905226:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905250:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905258:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905265:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905917:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905928:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.905935:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229038.907352:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1782229038.907367:0:10359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351903936238ns, next at 352903933383ns, rc = 0 00010000:00010000:2.0:1782229038.907478:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.907492:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.907502:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.907510:0:10359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.907516:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.907521:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908126:0:10359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229038.908163:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908172:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908179:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908185:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229038.908190:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908209:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908231:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:2.0:1782229038.908234:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782229038.908239:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908245:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e644b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908265:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908272:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908278:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908283:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229038.908286:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908292:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908299:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:2.0:1782229038.908301:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229038.908304:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229038.908309:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc000/0x8e1c8a3488e644a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782229038.908331:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b440c13b reply state 0000000013332d16 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229038.908339:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782229038.908462:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+37:11562:x1868802309575168:12345-192.168.204.22@tcp:36:rm.0 Request processed in 3466us (4371us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1782229038.908472:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 198 00010000:00010000:3.0:1782229038.910141:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229038.910162:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.910172:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229038.910176:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.910186:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.910210:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98fe58ddd500) 00010000:00010000:3.0:1782229038.910213:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782229038.910217:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.910224:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc200/0x8e1c8a3488e644bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229038.910269:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229038.910271:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229038.910273:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229038.911032:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.911044:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.911050:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.911055:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcda00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.911060:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.911066:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.911078:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe58ddd700) 00010000:00010000:0.0:1782229038.911081:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.911083:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.911102:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcda00/0x8e1c8a3488e644ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229038.972272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229038.974859:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309575424 00000100:00100000:0.0:1782229038.974876:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309575424 00000100:00100000:0.0:1782229038.975028:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 199 00000100:00100000:0.0:1782229038.975052:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+36:11568:x1868802309575424:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229038.975076:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229038.975098:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e644c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a0c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.975234:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.975249:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.975261:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.975275:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.975281:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.975287:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782229038.975880:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1782229038.976049:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976060:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976068:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976099:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976106:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976112:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976118:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229038.976122:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976129:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976141:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229038.976144:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229038.976148:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976154:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e644c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229038.976178:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2b21235 reply state 0000000013b4805d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229038.976188:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782229038.976218:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e644c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976233:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229038.976240:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:0.0:1782229038.976242:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229038.976244:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23600, rc 0) 00000100:00100000:0.0:1782229038.976326:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+39:11568:x1868802309575424:12345-192.168.204.22@tcp:101:bash.0 Request processed in 1289us (4064us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1782229038.976335:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 199 00010000:00010000:1.0:1782229038.981032:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.981052:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.981059:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.981064:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229038.981069:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.981076:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.981102:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe42cb9c00) 00010000:00010000:1.0:1782229038.981106:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229038.981110:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.981116:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e644d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229038.983039:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.983766:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309575552 00000100:00100000:1.0:1782229038.983777:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309575552 00000100:00100000:1.0:1782229038.983853:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 59 00000100:00100000:1.0:1782229038.983863:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309575552:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229038.983882:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1782229038.983943:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782229038.983958:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a13 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782229038.983987:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229038.984008:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1782229038.984013:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229038.984023:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.984041:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.984054:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421200, rc 0) 00000100:00100000:1.0:1782229038.984125:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309575552:12345-192.168.204.22@tcp:101:bash.0 Request processed in 262us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229038.984133:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 59 00000100:00100000:3.0:1782229038.992070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229038.992138:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309575680 00000100:00100000:1.0:1782229038.992147:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309575680 00000100:00100000:1.0:1782229038.992207:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 60 00000100:00100000:1.0:1782229038.992216:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+8:11568:x1868802309575680:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229038.992233:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229038.992249:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a1a expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.992278:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 9 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.992303:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229038.992307:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229038.992313:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 9 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.992343:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 9 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229038.992358:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 9 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229038.992373:0:6598:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6598:1868802329487360:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229038.992513:0:6598:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb80a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782229039.001014:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229039.001237:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309575808 00000100:00100000:2.0:1782229039.001247:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309575808 00010000:00010000:2.0:1782229039.001288:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 10 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.001334:0:6598:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6598:1868802329487360:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229039.001341:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 77 00000100:00100000:2.0:1782229039.001354:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2372:x1868802309575808:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229039.001369:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 10 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229039.001371:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229039.001391:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421a00, rc 0) 00010000:00010000:2.0:1782229039.001399:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 10 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229039.001417:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 10 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229039.001473:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e644e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a13 expref: 10 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.001485:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:11568:x1868802309575680:12345-192.168.204.22@tcp:101:bash.0 Request processed in 9267us (9423us total) trans 0 rc 0/0 00010000:00010000:2.0:1782229039.001489:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1782229039.001494:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 60 00010000:00010000:2.0:1782229039.001508:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229039.001519:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229039.001540:0:11530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229039.001574:0:11530:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229039.001588:0:11530:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11530:1868802329487488:192.168.204.22@tcp:105: 00000100:00100000:2.0:1782229039.001645:0:11530:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe47c68600 going to sleep for 11 seconds 00000100:00100000:2.0:1782229039.007417:0:11530:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77b90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11530:1868802329487488:192.168.204.22@tcp:105: 00010000:00010000:2.0:1782229039.007477:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229039.007548:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2372:x1868802309575808:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 6195us (6543us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229039.007559:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 77 00000100:00100000:0.0:1782229039.011662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.011934:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309576064 00000100:00100000:3.0:1782229039.011943:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309576064 00000100:00100000:3.0:1782229039.012071:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:3.0:1782229039.012084:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+38:11568:x1868802309576064:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:3.0:1782229039.012482:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+39:11568:x1868802309576064:12345-192.168.204.22@tcp:35:bash.0 Request processed in 400us (829us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1782229039.012490:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00080000:2.0:1782229039.012981:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229039.235148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.235672:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309576192 00000100:00100000:1.0:1782229039.235681:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309576192 00000100:00100000:1.0:1782229039.235750:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 200 00000100:00100000:1.0:1782229039.235776:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+39:11584:x1868802309576192:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229039.235801:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229039.235820:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e644f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a21 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.235887:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e644fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.235900:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e644fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.235912:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e644fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229039.235975:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1782229039.235979:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229039.236004:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e644fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.236028:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e644f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a21 expref: 41 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.236046:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e644fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a21 expref: 40 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.236053:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229039.236056:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782229039.236059:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420400, rc 0) 00000100:00100000:1.0:1782229039.236126:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+40:11584:x1868802309576192:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 352us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.236141:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 200 00000100:00100000:1.0:1782229039.245311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.245403:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309576448 00000100:00100000:3.0:1782229039.245413:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309576448 00000100:00100000:3.0:1782229039.245510:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 201 00000100:00100000:3.0:1782229039.245519:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+40:11584:x1868802309576448:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229039.245680:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229039.245700:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64501 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a28 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.245816:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.245830:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.245858:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229039.245870:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782229039.246079:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64501 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a28 expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.246103:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a28 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.246111:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:3.0:1782229039.246114:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782229039.246117:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917a00, rc 0) 00000100:00100000:3.0:1782229039.246540:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+42:11584:x1868802309576448:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 716us (933us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1782229039.246557:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 201 00000100:00100000:3.0:1782229039.254161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.254318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229039.255226:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309576576 00000100:00100000:0.0:1782229039.255236:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309576576 00000100:00100000:0.0:1782229039.255381:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:0.0:1782229039.255393:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+42:2371:x1868802309576576:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229039.255411:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229039.255450:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a28 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.255487:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:0.0:1782229039.255491:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229039.255572:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+41:2371:x1868802309576576:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 181us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229039.255579:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:1.0:1782229039.255645:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309576832 00000100:00100000:1.0:1782229039.255651:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309576832 00000100:00100000:1.0:1782229039.255688:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 202 00000100:00100000:1.0:1782229039.255695:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+41:11584:x1868802309576832:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229039.255716:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229039.255732:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a2f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.255825:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6451d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.255838:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6451d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.255848:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6451d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229039.255860:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782229039.255993:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a2f expref: 44 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.256008:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6451d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a2f expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.256015:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:1.0:1782229039.256018:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782229039.256028:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420600, rc 0) 00000100:00100000:1.0:1782229039.256053:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+43:11584:x1868802309576832:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 358us (1735us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1782229039.256060:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 202 00000100:00100000:0.0:1782229039.272255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.272351:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309576960 00000100:00100000:1.0:1782229039.272360:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309576960 00000100:00100000:1.0:1782229039.272418:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:1.0:1782229039.272462:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309576960:12345-192.168.204.22@tcp:1:lfs.0 00010000:00010000:1.0:1782229039.272509:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.272537:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.272654:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782229039.272658:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229039.272663:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.272710:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 8 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.272826:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 8 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.272844:0:6599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1868802329487616:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229039.272946:0:6599:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782229039.278848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.278985:0:6599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1868802329487616:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229039.279014:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.282840:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309577088 00000100:00100000:3.0:1782229039.282856:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309577088 00002000:00100000:3.0:1782229039.282914:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98fe77b90000 x1868802309577088/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:210/0 lens 504/0 e 0 to 0 dl 1782229050 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782229039.282924:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe77b90000 with x1868802309577088 ext(0->8) 00010000:00010000:3.0:1782229039.282932:0:6604:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 9 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.282951:0:6604:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 9 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782229039.282972:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe77b90000 00000100:00100000:3.0:1782229039.282997:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:3.0:1782229039.283008:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2372:x1868802309577088:12345-192.168.204.22@tcp:4:lfs.0 00000100:00100000:3.0:1782229039.284834:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2372:x1868802309577088:12345-192.168.204.22@tcp:4:lfs.0 Request processed in 1818us (5986us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782229039.284845:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 3 00002000:00100000:3.0:1782229039.284856:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98fe77b90000 x1868802309577088/t4294967308(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:210/0 lens 504/448 e 0 to 0 dl 1782229050 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782229039.284865:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe77b90000 with x1868802309577088 ext(0->8) 00010000:00010000:3.0:1782229039.284873:0:6604:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 11 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.284891:0:6604:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 11 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782229039.284898:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98fe77b90000 00000100:00100000:2.0:1782229039.298567:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.298660:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309577216 00000100:00100000:3.0:1782229039.298679:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309577216 00010000:00010000:3.0:1782229039.298721:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 11 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.298764:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 78 00000100:00100000:3.0:1782229039.298773:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2373:x1868802309577216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229039.298805:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782229039.298824:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782229039.298827:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782229039 00002000:00010000:3.0:1782229039.298830:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782229039 00002000:00010000:3.0:1782229039.298832:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782229039 00010000:00010000:3.0:1782229039.298838:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 11 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.298855:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 11 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.298879:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab75898/0x8e1c8a3488e644ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a1a expref: 11 pid: 6598 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.298896:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229039.298900:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229039.298905:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.298915:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.298949:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229039.299012:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2373:x1868802309577216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 240us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229039.299020:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 78 00010000:00010000:1.0:1782229039.299327:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299338:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299361:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299369:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299376:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299382:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229039.299386:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299394:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299419:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.299427:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e6452b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.299558:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2373:x1868802309576960:12345-192.168.204.22@tcp:1:lfs.0 Request processed in 27130us (27312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.299567:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:0.0:1782229039.324670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.325010:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309577472 00000100:00100000:3.0:1782229039.325021:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309577472 00000100:00100000:3.0:1782229039.325081:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:3.0:1782229039.325091:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42ec5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+43:11584:x1868802309577472:12345-192.168.204.22@tcp:35:lfs.0 00000004:00010000:3.0:1782229039.325154:0:5800:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6451d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a2f expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782229039.325482:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1782229039.325540:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1782229039.326167:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1782229039.326238:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.326255:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.326263:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.326297:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.326315:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 47 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.326329:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1868802329487744:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229039.326421:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782229039.335021:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.335858:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309577600 00000100:00100000:1.0:1782229039.335868:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309577600 00010000:00010000:1.0:1782229039.335913:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 48 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.335957:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 79 00000100:00100000:1.0:1782229039.335967:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+48:2372:x1868802309577600:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229039.335984:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229039.335991:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 48 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.336007:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 48 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.336029:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:1.0:1782229039.336035:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.336059:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.336066:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.336088:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229039.336154:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+48:2372:x1868802309577600:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 187us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.336163:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 79 00010000:00010000:3.0:1782229039.337362:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e644d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a0c expref: 47 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.337400:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1868802329487744:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229039.337425:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.337480:0:5800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.337486:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782229039.337625:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1782229039.337986:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1782229039.338107:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329487872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782229039.338166:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229039.338199:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8600 going to sleep for 11 seconds 00000100:00100000:1.0:1782229039.338313:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329487872 00000100:00100000:1.0:1782229039.338320:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329487872 00000100:00100000:1.0:1782229039.338387:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782229039.338395:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5800:x1868802329487872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782229039.338504:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5800:x1868802329487872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.338512:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1782229039.338631:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229039.338767:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329487872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782229039.339659:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1782229039.339842:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73d16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329488000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782229039.339887:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229039.339962:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58ce9780 going to sleep for 11 seconds 00000100:00100000:1.0:1782229039.344717:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329488000 00000100:00100000:1.0:1782229039.344730:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329488000 00000100:00100000:1.0:1782229039.344794:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782229039.344870:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5800:x1868802329488000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782229039.345183:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5800:x1868802329488000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 315us (5294us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782229039.345191:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782229039.345710:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73d16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1868802329488000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782229039.345791:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1782229039.345912:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.345924:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.345932:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.345938:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229039.345943:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.345963:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.345981:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:0.0:1782229039.345984:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782229039.345989:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.345995:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64532 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782229039.346187:0:5800:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782229039.346554:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1782229039.346566:0:5800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352343135143ns, next at 353343132928ns, rc = 0 00000001:00080000:0.0:1782229039.346695:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1782229039.346735:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:0.0:1782229039.346739:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782229039.346748:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e6451d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a2f expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229039.346866:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42ec5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+50:11584:x1868802309577472:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 21776us (22215us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1782229039.346875:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 56 00000020:00080000:0.0:1782229039.346879:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782229039.351630:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.353385:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309577728 00000100:00100000:1.0:1782229039.353397:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309577728 00000100:00100000:1.0:1782229039.353488:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 203 00000100:00100000:1.0:1782229039.353512:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+50:11584:x1868802309577728:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229039.353543:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229039.353567:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a36 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.353787:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a36 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.353802:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a36 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.353822:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229039.353825:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229039.353829:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421800, rc 0) 00000100:00100000:1.0:1782229039.353897:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+51:11584:x1868802309577728:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 387us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.353904:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 203 00000100:00100000:3.0:1782229039.361302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229039.362877:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309577984 00000100:00100000:0.0:1782229039.362891:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309577984 00000100:00100000:0.0:1782229039.362964:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:0.0:1782229039.362974:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+51:11584:x1868802309577984:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229039.363229:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11584:x1868802309577984:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 255us (1936us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1782229039.363237:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 57 00010000:00010000:3.0:1782229039.488031:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229039.520191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.520330:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309578112 00000100:00100000:3.0:1782229039.520341:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309578112 00000100:00100000:3.0:1782229039.520407:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 204 00000100:00100000:3.0:1782229039.520418:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11594:x1868802309578112:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:3.0:1782229039.520542:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520559:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520581:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520615:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520623:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520630:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520859:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520869:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520876:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782229039.520923:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.520936:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521139:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521146:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521152:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229039.521156:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521172:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521186:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229039.521189:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229039.521194:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521200:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521215:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521338:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521346:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521351:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229039.521354:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521360:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521368:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe43933b00) 00010000:00010000:3.0:1782229039.521371:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229039.521374:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521390:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521407:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521413:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521419:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521424:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229039.521427:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521514:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521531:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229039.521533:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229039.521536:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.521542:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6454e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.521644:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11594:x1868802309578112:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 1222us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229039.521654:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 204 00000100:00100000:2.0:1782229039.582280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.582368:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309578368 00000100:00100000:3.0:1782229039.582377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309578368 00000100:00100000:3.0:1782229039.582471:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 205 00000100:00100000:3.0:1782229039.582482:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+52:11597:x1868802309578368:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229039.582502:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229039.582533:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a3d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582614:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582630:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582641:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582667:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582675:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582682:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582823:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582831:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582855:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229039.582866:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782229039.582963:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582971:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582978:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582984:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229039.582988:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.582995:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583007:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229039.583011:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229039.583015:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583021:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e6455c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583035:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583041:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583054:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583058:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229039.583061:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583067:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583074:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe43933b00) 00010000:00010000:3.0:1782229039.583076:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229039.583078:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583083:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e64563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583257:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583275:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.583285:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229039.583288:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782229039.583291:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917800, rc 0) 00000100:00100000:3.0:1782229039.583530:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+54:11597:x1868802309578368:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1050us (1260us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1782229039.583547:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 205 00000100:00100000:2.0:1782229039.586384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.586523:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309578496 00000100:00100000:1.0:1782229039.586533:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309578496 00000100:00100000:1.0:1782229039.586694:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 206 00000100:00100000:1.0:1782229039.586705:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+54:11597:x1868802309578496:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:1.0:1782229039.586783:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586800:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586813:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586853:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586859:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586866:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586870:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229039.586874:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586881:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586894:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229039.586897:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229039.586900:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.586905:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e64578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.586974:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+54:11597:x1868802309578496:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 271us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.586982:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 206 00000100:00100000:2.0:1782229039.590745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229039.591026:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309578752 00000100:00100000:0.0:1782229039.591036:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309578752 00000100:00100000:0.0:1782229039.591177:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:0.0:1782229039.591187:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+54:11597:x1868802309578752:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:0.0:1782229039.592043:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:11597:x1868802309578752:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 853us (1303us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1782229039.592053:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:2.0:1782229039.693896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.694014:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309579008 00000100:00100000:1.0:1782229039.694024:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309579008 00000100:00100000:1.0:1782229039.694088:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 207 00000100:00100000:1.0:1782229039.694112:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:11607:x1868802309579008:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:1.0:1782229039.694136:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229039.694139:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782229039.694165:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e644fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a21 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.694186:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229039.694190:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782229039.694203:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6457f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a44 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.694310:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.694325:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.694334:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.694367:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.694384:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 55 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.694399:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329488128:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229039.694556:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6eb803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229039.697122:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1868802329488128:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229039.697150:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229039.700563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.700877:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309579136 00000100:00100000:3.0:1782229039.700888:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309579136 00010000:00010000:3.0:1782229039.700931:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 56 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.701009:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 80 00000100:00100000:3.0:1782229039.701019:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+56:2373:x1868802309579136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229039.701035:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229039.701052:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 56 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.701067:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 56 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.701088:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e6456a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a3d expref: 56 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.701104:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229039.701109:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.701117:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.701123:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.701166:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229039.701233:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:2373:x1868802309579136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 215us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229039.701240:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 80 00010000:00010000:1.0:1782229039.701304:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.701312:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229039.701329:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782229039.701505:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e6457f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.701533:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.701539:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229039.701542:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782229039.701544:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420c00, rc 0) 00000100:00100000:1.0:1782229039.701592:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+55:11607:x1868802309579008:12345-192.168.204.22@tcp:101:bash.0 Request processed in 7483us (7706us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1782229039.701600:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 207 00000100:00100000:2.0:1782229039.706065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.706129:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309579392 00000100:00100000:3.0:1782229039.706139:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309579392 00000100:00100000:3.0:1782229039.706202:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 208 00000100:00100000:3.0:1782229039.706211:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+55:11607:x1868802309579392:12345-192.168.204.22@tcp:36:bash.0 00010000:00010000:3.0:1782229039.706701:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.706729:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.706741:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782229039.706796:0:10359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1782229039.706976:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff754eec reply state 00000000142e41dd transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.706986:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782229039.707072:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11607:x1868802309579392:12345-192.168.204.22@tcp:36:bash.0 Request processed in 860us (1015us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1782229039.707080:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 208 00000020:00080000:3.0:1782229039.707085:0:10359:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229039.709908:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.709952:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.709960:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.709967:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229039.709972:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.709980:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.709998:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229039.710001:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229039.710005:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.710012:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e64594 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229039.712129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.712524:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309579520 00000100:00100000:3.0:1782229039.712536:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309579520 00000100:00100000:3.0:1782229039.714324:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 209 00000100:00100000:3.0:1782229039.714344:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11607:x1868802309579520:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229039.714372:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229039.714394:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6459b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a4b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.714508:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.714547:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.714557:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.714594:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.714611:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 58 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.714626:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329488256:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229039.714712:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782229039.720340:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329488256:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229039.720371:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229039.722864:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.722935:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309579648 00000100:00100000:1.0:1782229039.722945:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309579648 00010000:00010000:1.0:1782229039.722987:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 59 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.723031:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00100000:1.0:1782229039.723054:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+59:2372:x1868802309579648:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229039.723068:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229039.723074:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 59 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.723088:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 59 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.723109:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e64586 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a44 expref: 59 pid: 5796 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.723125:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229039.723130:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.723139:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.723147:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.723170:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229039.723236:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+58:2372:x1868802309579648:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 182us (379us total) trans 0 rc 0/0 00010000:00010000:3.0:1782229039.723241:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229039.723243:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 81 00010000:00010000:3.0:1782229039.723255:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229039.723304:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782229039.723309:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229039.723330:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.723373:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e6459b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 58 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.723390:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 57 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.723398:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229039.723401:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782229039.723404:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916000, rc 0) 00000100:00100000:3.0:1782229039.723507:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11607:x1868802309579520:12345-192.168.204.22@tcp:101:bash.0 Request processed in 9167us (11385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229039.723524:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 209 00000100:00100000:0.0:1782229039.729596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.729692:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309579904 00000100:00100000:3.0:1782229039.729701:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309579904 00000100:00100000:3.0:1782229039.730130:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 59 00000100:00100000:3.0:1782229039.730141:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+57:11607:x1868802309579904:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:3.0:1782229039.730507:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11607:x1868802309579904:12345-192.168.204.22@tcp:35:bash.0 Request processed in 367us (993us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1782229039.730589:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 59 00000001:00080000:1.0:1782229039.807306:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1782229039.807413:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1782229039.807425:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1782229039.858832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.858911:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309580032 00000100:00100000:1.0:1782229039.858945:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309580032 00000100:00100000:1.0:1782229039.859011:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 210 00000100:00100000:1.0:1782229039.859022:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+58:11613:x1868802309580032:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229039.859047:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229039.859067:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a52 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.859145:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e645b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.859160:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e645b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.859172:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e645b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229039.859235:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1782229039.859240:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229039.859265:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e645b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.859293:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a52 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.859311:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e645b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a52 expref: 59 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.859320:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229039.859323:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782229039.859327:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420000, rc 0) 00000100:00100000:1.0:1782229039.859921:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11613:x1868802309580032:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 898us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.859930:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 210 00000100:00100000:2.0:1782229039.867907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.871686:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309580160 00000100:00100000:1.0:1782229039.871701:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309580160 00000100:00100000:1.0:1782229039.871780:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 211 00000100:00100000:1.0:1782229039.871791:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11613:x1868802309580160:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229039.871813:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229039.871836:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a59 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.871901:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.871916:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.871926:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.871941:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.871947:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.871954:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872679:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e645cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872703:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e645cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872712:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e645cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229039.872753:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782229039.872758:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229039.872775:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e645cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872787:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e645cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872795:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872801:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872808:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872814:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229039.872819:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872826:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872838:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229039.872841:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229039.872851:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872858:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872874:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872879:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872885:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872890:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229039.872893:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872899:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872907:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe439ad100) 00010000:00010000:1.0:1782229039.872909:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229039.872912:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872917:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872950:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a59 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872975:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e645cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a59 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.872982:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229039.872984:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229039.872986:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420600, rc 0) 00000100:00100000:1.0:1782229039.873771:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11613:x1868802309580160:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1978us (5870us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.873781:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 211 00000100:00100000:0.0:1782229039.881203:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229039.881246:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.881317:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309580544 00000100:00100000:3.0:1782229039.881327:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309580544 00000100:00100000:3.0:1782229039.881539:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 212 00000100:00100000:3.0:1782229039.881553:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11613:x1868802309580544:12345-192.168.204.22@tcp:101:lfs.0 00000100:00100000:2.0:1782229039.881560:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309580288 00000100:00100000:2.0:1782229039.881567:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309580288 00010000:00010000:3.0:1782229039.881574:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229039.881597:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e645d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a60 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229039.881610:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:2.0:1782229039.881626:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+61:2370:x1868802309580288:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229039.881639:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229039.881660:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e645cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a59 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229039.881677:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:2.0:1782229039.881681:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229039.881729:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+60:2370:x1868802309580288:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 110us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229039.881736:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00010000:00010000:3.0:1782229039.883986:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.884007:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.884016:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.884054:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 60 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.884071:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 60 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229039.884086:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329488384:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229039.884496:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782229039.888405:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329488384:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229039.888469:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229039.892256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229039.892469:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309580672 00000100:00100000:0.0:1782229039.892478:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309580672 00010000:00010000:0.0:1782229039.892529:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 61 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229039.892560:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 82 00000100:00100000:0.0:1782229039.892569:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:2373:x1868802309580672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229039.892583:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229039.892589:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 61 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.892604:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 61 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.892638:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916000/0x8e1c8a3488e645a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a4b expref: 61 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.892665:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229039.892670:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.892679:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.892687:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229039.892990:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229039.893049:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+60:2373:x1868802309580672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 479us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229039.893056:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 82 00010000:00010000:3.0:1782229039.893231:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.893240:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229039.893260:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782229039.894155:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e645d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 61 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.894174:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 60 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.894183:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229039.894186:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782229039.894189:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917800, rc 0) 00000100:00100000:3.0:1782229039.894225:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11613:x1868802309580544:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 12676us (12978us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1782229039.894232:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 212 00000100:00100000:0.0:1782229039.900308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229039.900627:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309580928 00000100:00100000:2.0:1782229039.900636:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309580928 00000100:00100000:2.0:1782229039.900722:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:2.0:1782229039.900735:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11613:x1868802309580928:12345-192.168.204.22@tcp:103:lfs.0 00010000:00010000:2.0:1782229039.900752:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229039.900778:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e64539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a36 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229039.900806:0:11530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:2.0:1782229039.900825:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229039.900888:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11613:x1868802309580928:12345-192.168.204.22@tcp:103:lfs.0 Request processed in 156us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229039.900895:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:2.0:1782229039.904949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229039.905103:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309581056 00000100:00100000:3.0:1782229039.905114:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309581056 00000100:00100000:3.0:1782229039.905178:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 213 00000100:00100000:3.0:1782229039.905187:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11613:x1868802309581056:12345-192.168.204.22@tcp:58:lfs.0 00010000:00010000:3.0:1782229039.905308:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.905323:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229039.905334:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782229039.905571:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1782229039.905641:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11613:x1868802309581056:12345-192.168.204.22@tcp:58:lfs.0 Request processed in 454us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229039.905648:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 213 00000100:00100000:0.0:1782229039.911692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229039.911988:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309581184 00000100:00100000:1.0:1782229039.911999:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309581184 00000100:00100000:1.0:1782229039.912063:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 214 00000100:00100000:1.0:1782229039.912073:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+59:11613:x1868802309581184:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:1.0:1782229039.912092:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229039.912111:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a67 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.912167:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.912178:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.912197:0:5798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.912211:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.912236:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229039.912239:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782229039.912244:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229039.912252:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420c00, rc 0) 00000100:00100000:1.0:1782229039.912315:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11613:x1868802309581184:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 244us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229039.912323:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 214 00000040:00080000:3.0:1782229040.123913:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782229040.123923:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782229040.123959:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1782229040.123965:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782229040.124091:0:11549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329488512:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782229040.124192:0:11549:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8240 going to sleep for 11 seconds 00000100:00100000:0.0:1782229040.134624:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.134865:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309581312 00000100:00100000:1.0:1782229040.134875:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309581312 00000100:00100000:1.0:1782229040.134938:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 215 00000100:00100000:1.0:1782229040.134949:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309581312:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782229040.134983:0:5797:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782229040.135091:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309581312:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 143us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229040.135099:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 215 00000100:00100000:3.0:1782229040.135154:0:11549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c88700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329488512:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782229040.141706:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.141805:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309581440 00000100:00100000:1.0:1782229040.141815:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309581440 00000100:00100000:1.0:1782229040.141886:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 216 00000100:00100000:1.0:1782229040.141895:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11614:x1868802309581440:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782229040.141968:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.141985:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142011:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142355:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142366:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142373:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142402:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142409:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142414:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229040.142485:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782229040.142489:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782229040.142501:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142533:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142540:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142559:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142566:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229040.142570:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142577:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142589:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:1.0:1782229040.142592:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229040.142597:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142603:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420800/0x8e1c8a3488e645f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142615:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142621:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142626:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142631:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229040.142635:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142648:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142657:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98fe439ad100) 00010000:00010000:1.0:1782229040.142659:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229040.142663:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142669:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e645fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142683:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142689:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142695:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142699:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229040.142702:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142708:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142716:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229040.142718:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229040.142721:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.142737:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e64604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229040.142913:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11614:x1868802309581440:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 Request processed in 1016us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229040.142923:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 216 00000100:00100000:2.0:1782229040.156185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.156344:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309581696 00000100:00100000:1.0:1782229040.156353:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309581696 00000100:00100000:1.0:1782229040.156415:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 217 00000100:00100000:1.0:1782229040.156424:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+60:11614:x1868802309581696:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229040.156482:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229040.156516:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6460b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a6e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156630:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156645:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156657:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229040.156669:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782229040.156769:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156777:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156801:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156808:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229040.156812:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156819:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156832:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229040.156835:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782229040.156840:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156847:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420400/0x8e1c8a3488e64612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156901:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6460b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a6e expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156912:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:1.0:1782229040.156915:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782229040.156919:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421a00/0x8e1c8a3488e6460b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a6e expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.156928:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421a00, rc 0) 00000100:00100000:1.0:1782229040.157015:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309581696:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 591us (987us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1782229040.157032:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 217 00000100:00100000:0.0:1782229040.166411:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.171106:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309581824 00000100:00100000:1.0:1782229040.171121:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309581824 00000100:00100000:0.0:1782229040.171318:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 218 00000100:00100000:0.0:1782229040.171330:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309581824:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782229040.171372:0:5798:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782229040.171539:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309581824:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 210us (5140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.171547:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 218 00000100:00100000:3.0:1782229040.182118:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.182697:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309582080 00000100:00100000:1.0:1782229040.182708:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309582080 00000100:00100000:1.0:1782229040.182762:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 219 00000100:00100000:1.0:1782229040.182772:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309582080:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229040.182794:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229040.182798:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782229040.182828:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420000/0x8e1c8a3488e645b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a52 expref: 61 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.184588:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:1.0:1782229040.184599:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229040.184951:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64620 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a75 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782229040.185545:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1782229040.185757:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e64627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.185771:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e64627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.185782:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e64627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.185841:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64620 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a75 expref: 63 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.185873:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e64627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a75 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.185882:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:0.0:1782229040.185885:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229040.185887:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22c00, rc 0) 00000100:00100000:0.0:1782229040.185974:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11614:x1868802309582080:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 3198us (3861us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1782229040.185983:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 219 00000100:00100000:2.0:1782229040.199056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.199878:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309582336 00000100:00100000:3.0:1782229040.199890:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309582336 00000100:00100000:3.0:1782229040.199961:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 220 00000100:00100000:3.0:1782229040.199973:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11614:x1868802309582336:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782229040.200040:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229040.200068:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22c00/0x8e1c8a3488e64627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a75 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200088:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9300) 00010000:00010000:3.0:1782229040.200101:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229040.200124:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200138:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200147:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200179:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200187:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200194:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200270:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200277:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200283:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200288:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229040.200292:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200299:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200307:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:3.0:1782229040.200309:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229040.200312:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200317:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200332:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200338:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200344:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200349:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229040.200352:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200357:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200364:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xecb7c341 (ffff98fe43933f00) 00010000:00010000:3.0:1782229040.200366:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229040.200368:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.200373:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916e00/0x8e1c8a3488e6463c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xecb7c341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.200524:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7b75ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309582336:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 552us (1477us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782229040.200531:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 220 00000100:00100000:3.0:1782229040.202898:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.202970:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309582464 00000100:00100000:0.0:1782229040.202979:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309582464 00000100:00100000:0.0:1782229040.203037:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 221 00000100:00100000:0.0:1782229040.203046:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+61:11614:x1868802309582464:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229040.203081:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229040.203104:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64643 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a7c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.203139:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.203152:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.203162:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.203258:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 63 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.203278:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.203287:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:0.0:1782229040.203289:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782229040.203293:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23800, rc 0) 00000100:00100000:0.0:1782229040.203355:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11614:x1868802309582464:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 309us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.203362:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 221 00000100:00100000:1.0:1782229040.208115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.208326:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309582720 00000100:00100000:3.0:1782229040.208349:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309582720 00000100:00100000:3.0:1782229040.208407:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 222 00000100:00100000:3.0:1782229040.208417:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+62:11614:x1868802309582720:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782229040.209033:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.209052:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.209063:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229040.209309:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1782229040.209320:0:10359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353205888673ns, next at 354205886437ns, rc = 0 00000004:00010000:2.0:1782229040.209405:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8fe61da reply state 000000007ebc0047 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229040.209415:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782229040.211719:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+64:11614:x1868802309582720:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 3293us (3603us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1782229040.211730:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 222 00010000:00010000:1.0:1782229040.222656:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.222673:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.222680:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.222687:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229040.222692:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.222700:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.222742:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:1.0:1782229040.222745:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782229040.222750:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.222756:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64651 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229040.223686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.224295:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309582848 00000100:00100000:2.0:1782229040.224307:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309582848 00000100:00100000:2.0:1782229040.224363:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 223 00000100:00100000:2.0:1782229040.224373:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+63:11614:x1868802309582848:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229040.224411:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229040.224462:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a83 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.224546:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 64 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.224560:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 64 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.224579:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:2.0:1782229040.224582:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782229040.224585:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc400, rc 0) 00000100:00100000:2.0:1782229040.224651:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+64:11614:x1868802309582848:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 273us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.224659:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 223 00000100:00100000:2.0:1782229040.237289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.237607:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309582976 00000100:00100000:0.0:1782229040.237616:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309582976 00000100:00100000:0.0:1782229040.238029:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:0.0:1782229040.238041:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2372:x1868802309582976:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782229040.238344:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2372:x1868802309582976:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 305us (1063us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1782229040.238352:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:0.0:1782229040.244757:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.245108:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309583232 00000100:00100000:3.0:1782229040.245117:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309583232 00000100:00100000:3.0:1782229040.245176:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 60 00000100:00100000:3.0:1782229040.245186:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+64:11614:x1868802309583232:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782229040.245463:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+65:11614:x1868802309583232:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 277us (714us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1782229040.245471:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 60 00000100:00100000:1.0:1782229040.249391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.249485:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309583488 00000100:00100000:0.0:1782229040.249494:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309583488 00000100:00100000:0.0:1782229040.249562:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 224 00000100:00100000:0.0:1782229040.249572:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+65:11614:x1868802309583488:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782229040.249693:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+65:11614:x1868802309583488:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 122us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.249837:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 224 00000100:00080000:2.0:1782229040.249870:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229040.253957:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.254607:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309583616 00000100:00100000:2.0:1782229040.254617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309583616 00000100:00100000:2.0:1782229040.254689:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 225 00000100:00100000:2.0:1782229040.254699:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+65:11614:x1868802309583616:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229040.254733:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229040.254756:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e6465f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a8a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.254827:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e64666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.254854:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e64666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.254865:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e64666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229040.254904:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229040.254921:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e64666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.254944:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcde00/0x8e1c8a3488e6465f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a8a expref: 67 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.254961:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e64666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a8a expref: 66 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.254969:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:2.0:1782229040.254972:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782229040.254975:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc600, rc 0) 00000100:00100000:2.0:1782229040.255038:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+66:11614:x1868802309583616:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 341us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.255045:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 225 00000100:00100000:1.0:1782229040.272545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.272625:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309583744 00000100:00100000:3.0:1782229040.272635:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309583744 00000100:00100000:3.0:1782229040.272710:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:3.0:1782229040.272721:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+10:2371:x1868802309583744:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782229040.272738:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229040.272757:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a91 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782229040.272784:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3aa830, blocks: 0x1 00010000:00010000:3.0:1782229040.272803:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1782229040.272807:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229040.272816:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 11 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.272833:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 11 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.272866:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916e00, rc 0) 00000100:00100000:3.0:1782229040.272933:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2371:x1868802309583744:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 214us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229040.272940:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:1.0:1782229040.280019:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.280276:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309584000 00000100:00100000:0.0:1782229040.280287:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309584000 00000100:00100000:0.0:1782229040.280357:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 226 00000100:00100000:0.0:1782229040.280367:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+66:11614:x1868802309584000:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782229040.281021:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+66:11614:x1868802309584000:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 652us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229040.281030:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 226 00000100:00100000:2.0:1782229040.285058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.285330:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309584128 00000100:00100000:0.0:1782229040.285339:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309584128 00000100:00100000:0.0:1782229040.285398:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:0.0:1782229040.285408:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+11:11614:x1868802309584128:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782229040.285427:0:8488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229040.285494:0:8488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a98 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.285538:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 12 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.285564:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229040.285568:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229040.285573:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 12 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.285608:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 12 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.285623:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 12 pid: 6600 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229040.285636:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1868802329488640:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229040.285745:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe53aa6000 going to sleep for 11 seconds 00000100:00100000:2.0:1782229040.288848:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1868802329488640:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229040.288885:0:8488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 12 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.288927:0:8488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22400, rc 0) 00000100:00100000:2.0:1782229040.288993:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+12:11614:x1868802309584128:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 3586us (3944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.289002:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:3.0:1782229040.290997:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.291797:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309584256 00000100:00100000:2.0:1782229040.291806:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309584256 00010000:00010000:2.0:1782229040.291844:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 12 pid: 6600 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229040.291885:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 83 00000100:00100000:2.0:1782229040.291892:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+12:2372:x1868802309584256:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229040.291905:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229040.291925:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 12 pid: 6600 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.291940:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 12 pid: 6600 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.291962:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc248f19/0x8e1c8a3488e6466d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a91 expref: 12 pid: 6600 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.291979:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229040.291983:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229040.291992:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 11 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.292012:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 11 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.292051:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 11 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229040.292066:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1868802329488768:192.168.204.22@tcp:105: 00000100:00100000:2.0:1782229040.292149:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782229040.301579:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1868802329488768:192.168.204.22@tcp:105: 00010000:00010000:2.0:1782229040.301605:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229040.301676:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2372:x1868802309584256:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 9782us (10687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.301689:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 83 00000100:00100000:3.0:1782229040.301998:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.303380:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309584384 00000100:00100000:2.0:1782229040.303390:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309584384 00002000:00100000:2.0:1782229040.303493:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98fe8199a680 x1868802309584384/t0(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:211/0 lens 504/0 e 0 to 0 dl 1782229051 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229040.303512:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe8199a680 with x1868802309584384 ext(0->12) 00002000:00010000:2.0:1782229040.303517:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe8199a680 00000100:00100000:2.0:1782229040.303540:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:2.0:1782229040.303550:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe8199a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+11:2372:x1868802309584384:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782229040.304205:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe8199a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2372:x1868802309584384:12345-192.168.204.22@tcp:4:lhsmtool_posix.0 Request processed in 653us (2204us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782229040.304222:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00002000:00100000:2.0:1782229040.304231:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98fe8199a680 x1868802309584384/t4294967320(0) o4->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:211/0 lens 504/448 e 0 to 0 dl 1782229051 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782229040.304239:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe8199a680 with x1868802309584384 ext(0->12) 00002000:00010000:2.0:1782229040.304243:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe8199a680 00000100:00100000:0.0:1782229040.309072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.309178:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309584512 00000100:00100000:2.0:1782229040.309188:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309584512 00000100:00100000:2.0:1782229040.309284:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 227 00000100:00100000:2.0:1782229040.309294:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+66:11614:x1868802309584512:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1782229040.357718:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+66:11614:x1868802309584512:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 Request processed in 48415us (48647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229040.357732:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 227 00000001:00080000:3.0:1782229040.358466:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:3.0:1782229040.358485:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:1.0:1782229040.358721:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329488896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782229040.358778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1782229040.359019:0:5818:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe58ce9540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1782229040.359025:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe582bfb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe58ce9c00 00000020:00080000:3.0:1782229040.359028:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe582bf600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fd41ab3400 00000020:00080000:3.0:1782229040.359084:0:5818:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe7bc3ea80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1782229040.359087:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe58081800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe7bc3e840 00000020:00080000:3.0:1782229040.359090:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe58081100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fe779e3000 00000001:00080000:3.0:1782229040.359098:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1782229040.359101:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1782229040.359112:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:3.0:1782229040.359135:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1782229040.359194:0:5818:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1782229040.359213:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1782229040.359451:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1782229040.359740:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329488896 00000100:00100000:0.0:1782229040.359749:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329488896 00000100:00100000:0.0:1782229040.359801:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782229040.359810:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329488896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782229040.359837:0:6600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1782229040.359868:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3aa82f, atime: 0x6a3aa82f, ctime: 0x6a3aa82f, blocks: 0xb 00010000:00010000:0.0:1782229040.359876:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.359891:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1782229040.359909:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229040.359916:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.359934:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.359945:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.359953:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.359979:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229040.360014:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229040.360023:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.360043:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22c00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229040.360048:0:6613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.360057:0:6613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.360074:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.360082:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de75b685/0x8e1c8a3488e6467b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.360100:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229040.360103:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229040.360104:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229040.360778:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329489024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782229040.360904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229040.361002:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782229040.361009:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329489152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782229040.361038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229040.361132:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329489024 00000100:00100000:2.0:1782229040.361138:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329489024 00000100:00100000:2.0:1782229040.361183:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329489152 00000100:00100000:2.0:1782229040.361187:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329489152 00000100:00100000:2.0:1782229040.361201:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782229040.361208:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329489024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782229040.361225:0:8488:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1782229040.361240:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.361256:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 12 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.361264:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782229040.361268:0:8488:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782229040.361271:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.361306:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 12 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.361322:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 12 pid: 6598 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229040.361334:0:8488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1868802329489280:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229040.361387:0:8488:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe65fc0180 going to sleep for 11 seconds 00000100:00080000:3.0:1782229040.361510:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229040.361579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.361604:0:6598:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1782229040.361611:0:6598:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1782229040.361881:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1782229040.361889:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309584640 00000100:00100000:1.0:1782229040.361893:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309584640 00000100:00100000:0.0:1782229040.362987:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329488896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3173us (4203us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782229040.362997:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782229040.363025:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782229040.363035:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329489152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782229040.363185:0:3311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1782229040.363201:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:1.0:1782229040.363825:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe77c09880, transno 4294967307 00000004:00080000:1.0:1782229040.363844:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1782229040.363859:0:3311:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff98fe446afb80 x1868802329488896/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782229056 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782229040.363872:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe446afb80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1782229040.363878:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329488896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782229040.364309:0:12346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 68 00000100:00100000:2.0:1782229040.364321:0:12346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2373:x1868802309584640:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 00002000:00010000:0.0:1782229040.364937:0:6600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782229040.364943:0:6600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782229040 00002000:00010000:0.0:1782229040.364946:0:6600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1782229040.365210:0:8488:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8488:1868802329489280:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229040.365231:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229040.365234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.365268:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309584768 00000100:00100000:1.0:1782229040.365275:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309584768 00010000:00010000:1.0:1782229040.365300:0:11530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 14 pid: 6598 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229040.365332:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 84 00000100:00100000:1.0:1782229040.365340:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+14:2373:x1868802309584768:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229040.365351:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229040.365357:0:11530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 14 pid: 6598 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.365372:0:11530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 14 pid: 6598 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.366111:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a854e44f/0x8e1c8a3488e6443d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499f7 expref: 14 pid: 6598 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.366127:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229040.366141:0:11530:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229040.366147:0:11530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.366157:0:11530:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.366187:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229040.366243:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+13:2373:x1868802309584768:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 899us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229040.366252:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 84 00002000:00010000:0.0:1782229040.366392:0:6600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782229040 -> 1782229040 00002000:00010000:0.0:1782229040.366395:0:6600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782229040.366471:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1868802329489152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3437us (5430us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1782229040.366479:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1782229040.366727:0:8488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.366756:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.366778:0:8488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.366787:0:8488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.366803:0:8488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782229040.367181:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229040.367188:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.367196:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229040.367201:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782229040.367387:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fd42a7d180/2, rc 0, transno 4294967321 00000100:00100000:1.0:1782229040.367395:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329489152:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1782229040.368379:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.368399:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.368406:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64682 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.368451:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229040.368454:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229040.368458:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229040.370774:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1868802329489024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9559us (9863us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782229040.370786:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1782229040.370900:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fd42a7e680/2, rc 0, transno 4294967322 00000100:00100000:3.0:1782229040.370908:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329489024:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1782229040.393874:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1782229040.393890:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1782229040.393922:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1782229040.394175:0:12346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309584640:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 Request processed in 29851us (32589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.394186:0:12346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 68 00000100:00100000:1.0:1782229040.398018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.398178:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309585024 00000100:00100000:3.0:1782229040.398188:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309585024 00000100:00100000:3.0:1782229040.398251:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 228 00000100:00100000:3.0:1782229040.398261:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+20:11614:x1868802309585024:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782229040.398313:0:10359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229040.398341:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc600/0x8e1c8a3488e64666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a8a expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.398359:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:3.0:1782229040.398363:0:10359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229040.398392:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.398405:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.398414:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782229040.398976:0:10359:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb7dc48e reply state 000000001789ae3e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.399002:0:10359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782229040.399132:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+21:11614:x1868802309585024:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 871us (1122us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1782229040.399139:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 228 00000100:00100000:2.0:1782229040.403083:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229040.403464:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309585152 00000100:00100000:1.0:1782229040.403473:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309585152 00000100:00100000:1.0:1782229040.403545:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:1.0:1782229040.403555:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309585152:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782229040.403880:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782229040.403884:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1782229040 -> 1782229040 00002000:00010000:1.0:1782229040.403886:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782229039 00002000:00010000:1.0:1782229040.403889:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782229040 -> 1782229040 00002000:00010000:1.0:1782229040.403891:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782229040.404011:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2372:x1868802309585152:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 456us (937us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782229040.404019:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 69 00010000:00010000:3.0:1782229040.404254:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.404264:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.404272:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.404278:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229040.404283:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.404289:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.404305:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:3.0:1782229040.404308:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229040.404312:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.404317:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229040.407059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.407145:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309585408 00000100:00100000:3.0:1782229040.407157:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309585408 00000100:00100000:3.0:1782229040.407261:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 229 00000100:00100000:3.0:1782229040.407270:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+20:11614:x1868802309585408:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782229040.407335:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.407352:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.407362:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.407396:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.407412:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 20 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.407427:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329489408:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229040.407882:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782229040.411988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.412411:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1868802329489408:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229040.412467:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.412839:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309585536 00000100:00100000:3.0:1782229040.412847:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309585536 00010000:00010000:3.0:1782229040.412885:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.412927:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00100000:3.0:1782229040.412936:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+21:2372:x1868802309585536:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229040.412953:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229040.412959:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.412988:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.413012:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e6464a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a7c expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.413027:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:3.0:1782229040.413032:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.413041:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.413048:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.413077:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229040.413128:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+20:2372:x1868802309585536:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 193us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229040.413136:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 85 00010000:00010000:0.0:1782229040.414079:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414089:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414132:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414139:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414145:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414150:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229040.414154:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414161:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414173:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:0.0:1782229040.414176:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782229040.414180:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.414185:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64690 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229040.414259:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+19:11614:x1868802309585408:12345-192.168.204.22@tcp:55:lhsmtool_posix.0 Request processed in 6988us (7208us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782229040.414266:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 229 00000100:00100000:0.0:1782229040.417823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.417892:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309585664 00000100:00100000:3.0:1782229040.417903:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309585664 00000100:00100000:3.0:1782229040.417964:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:3.0:1782229040.417973:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309585664:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782229040.418018:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.418054:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.418062:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229040.418066:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782229040.418070:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.418108:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 8 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.418123:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 8 pid: 8488 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.418138:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1868802329489536:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229040.418217:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782229040.422178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.422250:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309585792 00000100:00100000:2.0:1782229040.422259:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309585792 00010000:00010000:2.0:1782229040.422301:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 9 pid: 8488 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229040.422343:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 86 00000100:00100000:2.0:1782229040.422354:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2372:x1868802309585792:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229040.422370:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229040.422391:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 9 pid: 8488 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.422406:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 9 pid: 8488 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.422464:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782229040.422468:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782229040.422475:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.422519:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229040.422539:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229040.422585:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+9:2372:x1868802309585792:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 232us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.422591:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 86 00010000:00010000:3.0:1782229040.423135:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af864d40/0x8e1c8a3488e64674 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a98 expref: 8 pid: 8488 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.423150:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1868802329489536:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229040.423173:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423183:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423199:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423225:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423234:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423242:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423249:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229040.423255:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423263:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423277:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.423285:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e64697 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.423363:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309585664:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 Request processed in 5391us (5549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229040.423372:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 70 00000100:00100000:1.0:1782229040.427417:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.427559:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309586048 00000100:00100000:0.0:1782229040.427569:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309586048 00000100:00100000:0.0:1782229040.427653:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 230 00000100:00100000:0.0:1782229040.427663:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+19:11614:x1868802309586048:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782229040.427759:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.427777:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.427789:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.427989:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.428001:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.428010:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.428043:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.428058:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 20 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229040.428072:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329489664:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229040.428153:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6062f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229040.431188:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329489664:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229040.431377:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229040.434838:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.435244:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309586176 00000100:00100000:3.0:1782229040.435253:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309586176 00010000:00010000:3.0:1782229040.435295:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.435379:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 87 00000100:00100000:3.0:1782229040.435390:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+21:2373:x1868802309586176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229040.435407:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229040.435415:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.435461:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.435484:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcc400/0x8e1c8a3488e64658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a83 expref: 21 pid: 5796 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.435509:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:3.0:1782229040.435515:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.435524:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.435548:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.435570:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229040.435647:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+20:2373:x1868802309586176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 251us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229040.435655:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 87 00010000:00010000:0.0:1782229040.436275:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.436286:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782229040.436527:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1782229040.436688:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1782229040.436892:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1782229040.436980:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329489792:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782229040.437039:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229040.437080:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782229040.437610:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329489792 00000100:00100000:2.0:1782229040.437618:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329489792 00000100:00100000:2.0:1782229040.437923:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782229040.437934:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1868802329489792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782229040.438017:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1868802329489792:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.438024:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782229040.438108:0:5798:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1782229040.438114:0:5798:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1782229040.438134:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fd42a7d180, transno 4294967321 00000100:00100000:0.0:1782229040.438157:0:5798:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff98fd42a7e680 x1868802329489024/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782229056 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229040.438168:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329489792:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1782229040.438904:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1782229040.438973:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329489920:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782229040.439013:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229040.439034:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41e656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782229040.439288:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329489920 00000100:00100000:2.0:1782229040.439294:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329489920 00000100:00100000:2.0:1782229040.439334:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782229040.439341:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5798:x1868802329489920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782229040.439529:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5798:x1868802329489920:12345-0@lo:1000:mdt00_002.0 Request processed in 188us (514us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1782229040.439537:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782229040.439631:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5798:1868802329489920:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1782229040.439838:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439861:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439868:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439874:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229040.439878:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439885:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439901:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe42cb9f00) 00010000:00010000:0.0:1782229040.439905:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229040.439909:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439915:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439947:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439953:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439959:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439964:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229040.439973:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439980:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.439990:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229040.439993:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229040.440000:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.440011:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.440021:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.440050:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229040.440062:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329490048:192.168.204.22@tcp:105: 00000100:00100000:0.0:1782229040.440461:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41e656c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229040.444044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.444142:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1868802329490048:192.168.204.22@tcp:105: 00010000:00010000:0.0:1782229040.444171:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444181:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e645e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444227:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444241:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444251:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444262:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444268:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444274:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444280:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229040.444283:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444290:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444301:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229040.444304:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229040.444308:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444313:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444334:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444340:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444346:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444351:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229040.444354:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444359:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444367:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229040.444370:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782229040.444373:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.444379:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e6469e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229040.444635:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+23:11614:x1868802309586048:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 16973us (17227us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1782229040.444654:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 230 00000020:00080000:0.0:1782229040.444660:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1782229040.444841:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309586304 00000100:00100000:3.0:1782229040.444848:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309586304 00000040:00080000:2.0:1782229040.444851:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782229040.444858:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1782229040.444899:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:3.0:1782229040.444909:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+23:11613:x1868802309586304:12345-192.168.204.22@tcp:49:lfs.0 00000100:00100000:3.0:1782229040.445005:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+23:11613:x1868802309586304:12345-192.168.204.22@tcp:49:lfs.0 Request processed in 97us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229040.445012:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 61 00000040:00080000:2.0:1782229040.445343:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1782229040.445351:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229040.448722:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.448798:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309586560 00000100:00100000:3.0:1782229040.448808:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309586560 00000100:00100000:3.0:1782229040.448864:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:3.0:1782229040.448875:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+23:11614:x1868802309586560:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782229040.449633:0:5800:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782229040.449749:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1782229040.449800:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.449816:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.449828:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.449844:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.449851:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.449857:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.449872:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782229040.449971:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+25:11614:x1868802309586560:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 1097us (1272us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1782229040.449980:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 62 00000020:00080000:3.0:1782229040.449984:0:5800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782229040.450345:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229040.450353:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.450360:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229040.450364:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.450373:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.450386:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98fe43933f00) 00010000:00010000:1.0:1782229040.450389:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782229040.450393:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.450399:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e646b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229040.450415:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229040.450417:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229040.450419:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229040.456514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229040.456609:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309586816 00000100:00100000:2.0:1782229040.456618:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309586816 00000100:00100000:2.0:1782229040.456682:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 231 00000100:00100000:2.0:1782229040.456692:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+25:11613:x1868802309586816:12345-192.168.204.22@tcp:58:lfs.0 00000040:00080000:2.0:1782229040.456978:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1782229040.457059:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+25:11613:x1868802309586816:12345-192.168.204.22@tcp:58:lfs.0 Request processed in 368us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.457067:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 231 00000100:00100000:2.0:1782229040.493988:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229040.494085:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309586944 00000100:00100000:0.0:1782229040.494095:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309586944 00000100:00100000:0.0:1782229040.494173:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 232 00000100:00100000:0.0:1782229040.494183:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+25:11617:x1868802309586944:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229040.494204:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229040.494224:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e646ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949a9f expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.494287:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.494301:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.494312:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.494326:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.494333:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.494341:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.494985:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.495001:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 26 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.495008:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.495049:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 26 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.495066:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 26 pid: 10359 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229040.495079:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329490176:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229040.495159:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41e656c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229040.502009:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.502093:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309587200 00000100:00100000:3.0:1782229040.502101:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309587200 00000100:00100000:3.0:1782229040.502169:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:3.0:1782229040.502180:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+27:5582:x1868802309587200:12345-192.168.204.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782229040.502426:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+28:5582:x1868802309587200:12345-192.168.204.22@tcp:35:ldlm_bl.0 Request processed in 248us (428us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1782229040.502462:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 63 00000100:00100000:0.0:1782229040.503519:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10359:1868802329490176:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229040.503544:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.509164:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229040.510059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229040.510140:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309587328 00000100:00100000:3.0:1782229040.510149:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309587328 00010000:00010000:3.0:1782229040.510188:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 28 pid: 10359 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229040.510228:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 88 00000100:00100000:3.0:1782229040.510254:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+28:2372:x1868802309587328:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229040.510271:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229040.510278:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 28 pid: 10359 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.510293:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 28 pid: 10359 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.510314:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e645da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a60 expref: 28 pid: 10359 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.510331:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229040.510336:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.510345:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.510353:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229040.510385:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229040.510481:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+27:2372:x1868802309587328:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 228us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229040.510489:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 88 00010000:00010000:0.0:1782229040.510988:0:10359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.510997:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229040.511040:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782229040.511045:0:10359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229040.511066:0:10359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511079:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511090:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511109:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511115:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511120:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23600 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229040.511124:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511130:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511141:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229040.511144:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229040.511147:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511152:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23600/0x8e1c8a3488e646c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511164:0:10359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511171:0:10359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511176:0:10359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511181:0:10359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229040.511189:0:10359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511196:0:10359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511204:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98fe42cb9f00) 00010000:00010000:0.0:1782229040.511206:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229040.511209:0:10359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511214:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e646c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511249:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e646ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a9f expref: 27 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511263:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a9f expref: 26 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229040.511270:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229040.511271:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229040.511274:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23c00, rc 0) 00000100:00100000:0.0:1782229040.511327:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11617:x1868802309586944:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 17146us (17349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.511334:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 232 00000100:00100000:1.0:1782229040.764021:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd43424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329490688:0@lo:400:kworker.0 00000100:00100000:1.0:1782229040.764095:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229040.764164:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782229040.764171:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd43425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329490560:0@lo:400:kworker.0 00000100:00100000:1.0:1782229040.764191:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229040.764266:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd43425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329490432:0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764293:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229040.764316:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782229040.764328:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd43427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329490304:0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764357:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229040.764393:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329490688 00000100:00100000:0.0:1782229040.764399:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329490688 00000100:00100000:0.0:1782229040.764469:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329490560 00000100:00100000:0.0:1782229040.764472:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329490560 00000100:00100000:0.0:1782229040.764489:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329490432 00000100:00100000:0.0:1782229040.764501:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329490432 00000100:00100000:0.0:1782229040.764519:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782229040.764527:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329490688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764580:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329490688:12345-0@lo:400:kworker.0 Request processed in 53us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.764588:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782229040.764603:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782229040.764608:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329490560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764632:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329490560:12345-0@lo:400:kworker.0 Request processed in 24us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.764637:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782229040.764645:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782229040.764650:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329490432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764674:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329490432:12345-0@lo:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.764678:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782229040.764760:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329490304 00000100:00100000:0.0:1782229040.764765:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329490304 00000100:00100000:0.0:1782229040.764791:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1782229040.764798:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329490304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764837:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329490304:12345-0@lo:400:kworker.0 Request processed in 40us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229040.764843:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1782229040.764868:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229040.764899:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd43427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329490304:0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764912:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd43425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329490432:0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764938:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd43425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329490560:0@lo:400:kworker.0 00000100:00100000:0.0:1782229040.764948:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd43424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329490688:0@lo:400:kworker.0 00000100:00100000:3.0:1782229040.765580:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329490816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782229040.765616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229040.765843:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329490816 00000100:00100000:2.0:1782229040.765850:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329490816 00000100:00100000:2.0:1782229040.765890:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782229040.765898:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1868802329490816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782229040.765916:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782229040.766010:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1868802329490816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229040.766017:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782229040.769914:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329490816:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1782229041.266902:0:12384:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782229041.266911:0:12384:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782229041.266950:0:12384:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782229041.266956:0:12384:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782229041.280007:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782229041.280029:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd43424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329490944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782229041.280094:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229041.280181:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329490944 00000100:00100000:2.0:1782229041.280188:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329490944 00000100:00100000:2.0:1782229041.280248:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782229041.280259:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329490944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782229041.280298:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229041.280359:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329490944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229041.280366:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782229041.280422:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd43424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329490944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782229041.280516:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1782229041.467955:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782229041.467964:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782229041.467997:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782229041.468005:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229041.468131:0:11549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329491072:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782229041.468231:0:11549:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1782229041.475351:0:11549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11549:1868802329491072:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782229041.479464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229041.479797:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309587456 00000100:00100000:0.0:1782229041.479806:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309587456 00000100:00100000:0.0:1782229041.479878:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 233 00000100:00100000:0.0:1782229041.479888:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11629:x1868802309587456:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782229041.479922:0:5797:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782229041.480339:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11629:x1868802309587456:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 451us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229041.480347:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 233 00000100:00080000:3.0:1782229041.484389:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229041.485367:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229041.485579:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309587712 00000100:00100000:1.0:1782229041.485590:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309587712 00000100:00100000:1.0:1782229041.485683:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 234 00000100:00100000:1.0:1782229041.485694:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+26:11629:x1868802309587712:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229041.485714:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229041.485746:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e646d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949aa6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229041.485858:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e646dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229041.485873:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e646dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229041.485885:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e646dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782229041.485895:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782229041.486076:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74421800/0x8e1c8a3488e646d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949aa6 expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229041.486097:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e646dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949aa6 expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229041.486106:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229041.486108:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229041.486311:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420600, rc 0) 00000100:00100000:1.0:1782229041.486467:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+28:11629:x1868802309587712:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 774us (1104us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1782229041.486475:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 234 00000100:00100000:2.0:1782229041.498135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229041.498197:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229041.498409:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309587840 00000100:00100000:1.0:1782229041.498421:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309587840 00000100:00100000:1.0:1782229041.498515:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:1.0:1782229041.498524:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+28:2373:x1868802309587840:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229041.498540:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229041.498564:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420600/0x8e1c8a3488e646dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949aa6 expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229041.498584:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:1.0:1782229041.498588:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229041.498649:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+27:2373:x1868802309587840:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 125us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229041.498657:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:0.0:1782229041.499282:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309588096 00000100:00100000:0.0:1782229041.499288:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309588096 00000100:00100000:0.0:1782229041.499340:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 235 00000100:00100000:0.0:1782229041.499349:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+27:11629:x1868802309588096:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782229041.499422:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499453:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499487:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499842:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499851:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499858:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499864:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229041.499869:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499877:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499887:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229041.499890:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782229041.499894:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229041.499899:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e646eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229041.500027:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+28:11629:x1868802309588096:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 678us (1828us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1782229041.500034:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 235 00000040:00080000:3.0:1782229041.500304:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782229041.500309:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782229041.500899:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782229041.500908:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229041.505940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229041.506038:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309588352 00000100:00100000:3.0:1782229041.506048:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309588352 00000100:00100000:3.0:1782229041.506113:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 64 00000100:00100000:3.0:1782229041.506125:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+28:11629:x1868802309588352:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782229041.506385:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+29:11629:x1868802309588352:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 261us (455us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1782229041.506393:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 64 00010000:00010000:0.0:1782229041.531554:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229041.732544:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229041.732643:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229041.732673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229041.732704:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229041.732740:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309588736 00000100:00100000:1.0:1782229041.732751:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309588736 00000100:00100000:0.0:1782229041.732770:0:12346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309588608 00000100:00100000:0.0:1782229041.732776:0:12346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309588608 00000100:00100000:1.0:1782229041.732817:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 74 00000100:00100000:0.0:1782229041.732826:0:12346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 75 00000100:00100000:1.0:1782229041.732832:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2370:x1868802309588736:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229041.732841:0:12346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309588608:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229041.732991:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309588480 00000100:00100000:3.0:1782229041.732996:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309588480 00000100:00100000:3.0:1782229041.733027:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 297 00000100:00100000:3.0:1782229041.733034:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309588480:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229041.738074:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309588864 00000100:00100000:2.0:1782229041.738088:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309588864 00000100:00100000:1.0:1782229041.738096:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2370:x1868802309588736:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 5262us (5445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229041.738111:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 74 00000100:00100000:2.0:1782229041.738146:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 159 00000100:00100000:2.0:1782229041.738157:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309588864:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229041.738208:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309588864:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 53us (5502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229041.738213:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 159 00000100:00080000:2.0:1782229041.738278:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782229041.738282:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229041.741652:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50247c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309588480:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 8607us (9106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229041.741668:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 297 00000100:00100000:0.0:1782229041.741681:0:12346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309588608:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 8841us (9004us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229041.741693:0:12346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 75 00010000:00010000:3.0:1782229042.555956:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782229043.064063:0:12436:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782229043.064072:0:12436:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782229043.064118:0:12436:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1782229043.064124:0:12436:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782229043.254117:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229043.254211:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309589120 00000100:00100000:3.0:1782229043.254234:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309589120 00000100:00080000:2.0:1782229043.254363:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229043.254408:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 236 00000100:00100000:3.0:1782229043.254421:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+29:11649:x1868802309589120:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229043.254479:0:10359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229043.254503:0:10359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e646f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949aad expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229043.254606:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e646f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229043.254619:0:10359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e646f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229043.254632:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e646f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229043.254643:0:10359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782229043.254784:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e646f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949aad expref: 32 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229043.254802:0:10359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e646f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949aad expref: 31 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229043.254812:0:10359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:3.0:1782229043.254815:0:10359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782229043.254819:0:10359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917800, rc 0) 00000100:00100000:3.0:1782229043.254882:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+31:11649:x1868802309589120:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 465us (774us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1782229043.254889:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 236 00000100:00100000:0.0:1782229043.260373:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229043.260491:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309589248 00000100:00100000:2.0:1782229043.260501:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309589248 00000100:00100000:2.0:1782229043.260576:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 237 00000100:00100000:2.0:1782229043.260587:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+31:11649:x1868802309589248:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:2.0:1782229043.260656:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260673:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260685:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260711:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260718:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260727:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260733:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229043.260737:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260744:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260773:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:2.0:1782229043.260776:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229043.260781:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229043.260788:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcdc00/0x8e1c8a3488e64707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229043.260857:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+31:11649:x1868802309589248:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 271us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229043.260864:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 237 00000100:00100000:0.0:1782229043.382879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229043.382972:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309589376 00000100:00100000:3.0:1782229043.382983:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309589376 00000100:00100000:3.0:1782229043.383056:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 71 00000100:00100000:3.0:1782229043.383066:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe66070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2372:x1868802309589376:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:3.0:1782229043.383083:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229043.383171:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e6470e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949ab4 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782229043.383198:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a3aa830, atime: 0x6a3aa82f, ctime: 0x6a3aa830, blocks: 0xb 00010000:00010000:3.0:1782229043.383215:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1782229043.383219:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229043.383228:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e6470e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ab4 expref: 8 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229043.383246:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e6470e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ab4 expref: 8 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229043.383259:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917a00, rc 0) 00000100:00080000:2.0:1782229043.383409:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782229043.383477:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe66070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2372:x1868802309589376:12345-192.168.204.22@tcp:101:cat.0 Request processed in 411us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229043.383484:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 71 00000100:00100000:3.0:1782229043.392532:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229043.392948:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309589504 00000100:00100000:0.0:1782229043.392957:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309589504 00002000:00100000:0.0:1782229043.393007:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98fe81999f80 x1868802309589504/t0(0) o3->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:214/0 lens 488/0 e 0 to 0 dl 1782229054 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782229043.393019:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe81999f80 with x1868802309589504 ext(0->4095) 00002000:00010000:0.0:1782229043.393024:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe81999f80 00000100:00100000:0.0:1782229043.393055:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:0.0:1782229043.393063:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309589504:12345-192.168.204.22@tcp:3:cat.0 00000100:00100000:0.0:1782229043.393267:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+8:2373:x1868802309589504:12345-192.168.204.22@tcp:3:cat.0 Request processed in 204us (745us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1782229043.393275:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00002000:00100000:0.0:1782229043.393281:0:6604:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98fe81999f80 x1868802309589504/t0(0) o3->2d74cab1-6977-468d-a933-6ac020ef49f3@192.168.204.22@tcp:214/0 lens 488/4536 e 0 to 0 dl 1782229054 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782229043.393304:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe81999f80 with x1868802309589504 ext(0->4095) 00002000:00010000:0.0:1782229043.393307:0:6604:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98fe81999f80 00010000:00010000:3.0:1782229043.579821:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229044.606288:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782229044.932181:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1782229045.447295:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1782229045.447318:0:5818:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98fe43e603c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1782229045.447324:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe582bf400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98fe43e60c00 00000020:00080000:2.0:1782229045.447328:0:5818:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff98fe582bfc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98fe779e3400 00000001:00080000:2.0:1782229045.447365:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1782229045.447548:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:2.0:1782229045.447731:0:5818:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1782229045.448866:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1782229045.454257:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1782229045.454289:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:3.0:1782229045.630594:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229045.883770:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329491584:0@lo:400:kworker.0 00000100:00100000:0.0:1782229045.883850:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229045.883914:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782229045.883920:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329491456:0@lo:400:kworker.0 00000100:00100000:0.0:1782229045.883945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229045.883977:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329491456 00000100:00100000:0.0:1782229045.883984:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329491456 00000100:00100000:0.0:1782229045.884047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782229045.884057:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329491456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229045.884108:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329491456:12345-0@lo:400:kworker.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229045.884115:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1782229045.884138:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229045.884164:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329491456:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.884645:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329491328:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.884683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229045.884735:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329491840:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.884761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229045.884785:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782229045.884791:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329491200:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.884819:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229045.884847:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329491712:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.884867:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229045.884896:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329491584 00000100:00100000:1.0:1782229045.884900:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329491584 00000100:00100000:1.0:1782229045.884934:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329491840 00000100:00100000:1.0:1782229045.884937:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329491840 00000100:00100000:1.0:1782229045.884958:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782229045.884965:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885004:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329491584:12345-0@lo:400:kworker.0 Request processed in 40us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229045.885010:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782229045.885022:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782229045.885026:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885051:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329491840:12345-0@lo:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229045.885056:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782229045.885072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329491200 00000100:00100000:1.0:1782229045.885075:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329491200 00000100:00100000:1.0:1782229045.885093:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782229045.885098:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885121:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50245450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329491200:12345-0@lo:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229045.885136:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782229045.885164:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329491328 00000100:00100000:1.0:1782229045.885167:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329491328 00000100:00100000:1.0:1782229045.885187:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329491712 00000100:00100000:1.0:1782229045.885190:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329491712 00000100:00100000:1.0:1782229045.885204:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782229045.885209:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329491328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885239:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329491328:12345-0@lo:400:kworker.0 Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229045.885245:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782229045.885255:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782229045.885268:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329491712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885295:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329491712:12345-0@lo:400:kworker.0 Request processed in 35us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229045.885300:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1782229045.885314:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782229045.885318:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782229045.885320:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782229045.885342:0:3311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1782229045.885346:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fe446afb80, transno 4294967310 00000100:00100000:1.0:1782229045.885357:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329491584:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885378:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329491200:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885387:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329491712:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885410:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329491328:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.885417:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1782229045.885425:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98fd42a7e680, transno 4294967322 00000004:00080000:1.0:1782229045.885463:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1782229045.885481:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329491840:0@lo:400:kworker.0 00000100:00100000:1.0:1782229045.887364:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782229045.887382:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe59e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329491968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229045.887474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229045.890096:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329491968 00000100:00100000:2.0:1782229045.890110:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329491968 00000100:00100000:2.0:1782229045.890233:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782229045.890244:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329491968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782229045.890293:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229045.890376:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329491968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229045.890382:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782229045.890487:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe59e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329491968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782229046.396003:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782229046.396150:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe59e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329492096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782229046.396235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229046.396517:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492096 00000100:00100000:2.0:1782229046.396525:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492096 00000100:00100000:2.0:1782229046.396584:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782229046.396595:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329492096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782229046.396632:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229046.397000:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329492096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 405us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229046.397010:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782229046.398836:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe59e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329492096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782229046.659823:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229046.847152:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229046.847192:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229046.847225:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229046.847245:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229046.847268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229046.847299:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309589888 00000100:00100000:2.0:1782229046.847308:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309589888 00000100:00100000:2.0:1782229046.847364:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309590016 00000100:00100000:2.0:1782229046.847367:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309590016 00000100:00100000:2.0:1782229046.847404:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 78 00000100:00100000:2.0:1782229046.847413:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309589888:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229046.847526:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2370:x1868802309589888:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 102us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229046.847535:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 78 00000100:00100000:2.0:1782229046.847554:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 79 00000100:00100000:2.0:1782229046.847560:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2370:x1868802309590016:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229046.847591:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2370:x1868802309590016:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 31us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229046.847597:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 79 00000100:00100000:2.0:1782229046.847615:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309590144 00000100:00100000:2.0:1782229046.847618:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309590144 00000100:00100000:2.0:1782229046.847649:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309589760 00000100:00100000:2.0:1782229046.847652:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309589760 00000100:00100000:2.0:1782229046.847672:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 163 00000100:00100000:2.0:1782229046.847677:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309590144:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229046.847703:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+5:2370:x1868802309590144:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229046.847722:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 163 00000100:00100000:2.0:1782229046.847732:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 164 00000100:00100000:2.0:1782229046.847738:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2370:x1868802309589760:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229046.847761:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2370:x1868802309589760:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229046.847766:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 164 00000100:00080000:2.0:1782229046.847787:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782229046.847792:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782229046.847794:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229046.848659:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309589632 00000100:00100000:3.0:1782229046.848666:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309589632 00000100:00100000:3.0:1782229046.848861:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 299 00000100:00100000:3.0:1782229046.848873:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309589632:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229046.848916:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309589632:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 47us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229046.848923:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 299 00010000:00010000:0.0:1782229047.675754:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229048.699681:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782229048.700612:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782229048.700619:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782229048.700654:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782229048.700660:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782229048.939778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229048.939903:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309590272 00000100:00100000:2.0:1782229048.939916:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309590272 00000100:00100000:2.0:1782229048.940019:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 238 00000100:00100000:2.0:1782229048.940033:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11302:x1868802309590272:12345-192.168.204.22@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782229048.940182:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11302:x1868802309590272:12345-192.168.204.22@tcp:60:lhsmtool_posix.0 Request processed in 150us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229048.940200:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 238 00000100:00080000:1.0:1782229048.940364:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229048.947039:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229048.947144:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309590528 00000100:00100000:0.0:1782229048.947157:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309590528 00000100:00100000:0.0:1782229048.947244:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 65 00000100:00100000:0.0:1782229048.947257:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:11302:x1868802309590528:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782229048.948640:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+19:11302:x1868802309590528:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 1376us (1606us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1782229048.948653:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 65 00000100:00100000:0.0:1782229049.272671:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229049.279358:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309590656 00000100:00100000:2.0:1782229049.279374:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309590656 00000100:00100000:3.0:1782229049.279774:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 239 00000100:00100000:3.0:1782229049.279788:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+5:12102:x1868802309590656:12345-192.168.204.22@tcp:101:lsof.0 00010000:00010000:3.0:1782229049.279817:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229049.279847:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949abb expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229049.279928:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6471c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229049.279950:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6471c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229049.279963:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6471c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229049.280284:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782229049.280296:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229049.280482:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6471c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229049.280508:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917e00/0x8e1c8a3488e64715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949abb expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229049.280524:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6471c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949abb expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229049.280532:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:3.0:1782229049.280535:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782229049.280538:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916c00, rc 0) 00000100:00100000:3.0:1782229049.280916:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:12102:x1868802309590656:12345-192.168.204.22@tcp:101:lsof.0 Request processed in 1131us (8255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229049.280925:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 239 00000100:00080000:1.0:1782229049.288541:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782229049.723978:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782229050.550100:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1782229050.550137:0:5818:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1782229050.550177:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1782229050.550188:0:5829:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1782229050.747783:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229051.003834:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329492224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229051.003910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229051.004280:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492224 00000100:00100000:2.0:1782229051.004289:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492224 00000100:00100000:2.0:1782229051.004371:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782229051.004381:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329492224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782229051.004450:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229051.004498:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329492224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229051.004505:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782229051.004620:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329492224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229051.004642:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329492736:0@lo:400:kworker.0 00000100:00100000:0.0:1782229051.004670:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229051.004688:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782229051.004694:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329492352:0@lo:400:kworker.0 00000100:00100000:0.0:1782229051.004721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229051.004773:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329492480:0@lo:400:kworker.0 00000100:00100000:3.0:1782229051.004804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229051.004863:0:12346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492736 00000100:00100000:2.0:1782229051.004868:0:12346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492736 00000100:00100000:2.0:1782229051.004900:0:12346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782229051.004907:0:12346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329492736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229051.004943:0:12346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329492736:12345-0@lo:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229051.004949:0:12346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782229051.004970:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492480 00000100:00100000:2.0:1782229051.004987:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492480 00000100:00100000:2.0:1782229051.005013:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782229051.005019:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329492480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229051.005050:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329492480:12345-0@lo:400:kworker.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229051.005055:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782229051.005086:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329492608:0@lo:400:kworker.0 00000100:00100000:2.0:1782229051.005110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782229051.007316:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782229051.007326:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229051.007381:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492352 00000100:00100000:1.0:1782229051.007391:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492352 00000100:00100000:1.0:1782229051.007477:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1782229051.007487:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329492352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229051.008397:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3308:1868802329492352:0@lo:400:kworker.0 00000100:00100000:1.0:1782229051.008462:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3308:x1868802329492352:12345-0@lo:400:kworker.0 Request processed in 975us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229051.008472:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1782229051.008585:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe81998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329492480:0@lo:400:kworker.0 00000100:00100000:3.0:1782229051.008636:0:10359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492608 00000100:00100000:3.0:1782229051.008641:0:10359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492608 00000100:00100000:3.0:1782229051.008684:0:10359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782229051.008692:0:10359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329492608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229051.008740:0:10359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe68fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329492608:12345-0@lo:400:kworker.0 Request processed in 50us (3628us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229051.008746:0:10359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1782229051.008804:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229051.010404:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329492864:0@lo:400:kworker.0 00000100:00100000:0.0:1782229051.010494:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229051.010551:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329492736:0@lo:400:kworker.0 00000100:00100000:3.0:1782229051.010725:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492864 00000100:00100000:3.0:1782229051.010731:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492864 00000100:00100000:3.0:1782229051.010789:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1782229051.010798:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329492864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229051.010849:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329492864:12345-0@lo:400:kworker.0 Request processed in 47us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229051.010856:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782229051.010931:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329492864:0@lo:400:kworker.0 00000100:00080000:1.0:1782229051.011100:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229051.013135:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329492608:0@lo:400:kworker.0 00000100:00100000:0.0:1782229051.519256:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782229051.519291:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329492992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782229051.519362:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229051.519661:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329492992 00000100:00100000:2.0:1782229051.519670:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329492992 00000100:00100000:2.0:1782229051.519726:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782229051.519736:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329492992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782229051.519800:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229051.519856:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329492992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229051.519874:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782229051.520043:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329492992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782229051.773951:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229051.968250:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229051.968310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229051.968319:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309590784 00000100:00100000:2.0:1782229051.968331:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309590784 00000100:00100000:1.0:1782229051.968374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229051.968384:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 301 00000100:00100000:1.0:1782229051.968399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229051.968409:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2371:x1868802309590784:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229051.968426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229051.968497:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591040 00000100:00100000:1.0:1782229051.968513:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591040 00000100:00100000:2.0:1782229051.968523:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2371:x1868802309590784:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 128us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229051.968532:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 301 00000100:00100000:1.0:1782229051.968555:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591168 00000100:00100000:1.0:1782229051.968560:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591168 00000100:00080000:2.0:1782229051.968583:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782229051.968589:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782229051.968593:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00100000:1.0:1782229051.968602:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2371:x1868802309591040:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229051.968614:0:12346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 82 00000100:00100000:2.0:1782229051.968625:0:12346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2371:x1868802309591168:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229051.968638:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2371:x1868802309591040:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229051.968645:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00100000:2.0:1782229051.968664:0:12346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2371:x1868802309591168:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 41us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229051.968671:0:12346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 82 00000100:00100000:3.0:1782229051.971142:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591296 00000100:00100000:3.0:1782229051.971155:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591296 00000100:00100000:3.0:1782229051.971291:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309590912 00000100:00100000:3.0:1782229051.971295:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309590912 00000100:00100000:0.0:1782229051.971351:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 168 00000100:00100000:0.0:1782229051.971364:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+6:2371:x1868802309591296:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229051.971502:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4188f868-851e-4c26-a016-17a3b5288455+6:2371:x1868802309591296:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 141us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229051.971510:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 168 00000100:00080000:2.0:1782229051.971884:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229051.973599:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 169 00000100:00100000:3.0:1782229051.973613:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2371:x1868802309590912:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229051.973703:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2371:x1868802309590912:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 94us (5303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229051.973710:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 169 00010000:00010000:1.0:1782229052.797619:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782229052.809167:0:12640:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:37:31 (1782229051) 00010000:00010000:0.0:1782229053.819888:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229054.844137:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229055.869415:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229056.123776:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329493120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229056.123867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229056.124089:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329493120 00000100:00100000:2.0:1782229056.124098:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329493120 00000100:00100000:2.0:1782229056.124170:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782229056.124181:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329493120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782229056.124237:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782229056.124333:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782229056.124486:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329493120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 307us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229056.124509:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782229056.124660:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329493120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229056.125604:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782229056.125666:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782229056.125682:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329493376:0@lo:400:kworker.0 00000100:00100000:0.0:1782229056.125732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229056.126774:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329493376 00000100:00100000:3.0:1782229056.126784:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329493376 00000100:00100000:3.0:1782229056.126853:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1782229056.126863:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329493376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229056.126931:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329493376:12345-0@lo:400:kworker.0 Request processed in 69us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229056.126938:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782229056.127056:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329493376:0@lo:400:kworker.0 00000100:00100000:1.0:1782229056.129762:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329493248:0@lo:400:kworker.0 00000100:00100000:1.0:1782229056.129857:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229056.129994:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329493248 00000100:00100000:0.0:1782229056.130003:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329493248 00000100:00100000:0.0:1782229056.130062:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1782229056.130072:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229056.130143:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329493248:12345-0@lo:400:kworker.0 Request processed in 73us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229056.130150:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1782229056.130884:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329493248:0@lo:400:kworker.0 00000100:00100000:2.0:1782229056.131073:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329493632:0@lo:400:kworker.0 00000100:00100000:2.0:1782229056.131116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229056.131143:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782229056.131149:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329493504:0@lo:400:kworker.0 00000100:00100000:2.0:1782229056.131175:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229056.131220:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329493632 00000100:00100000:2.0:1782229056.131225:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329493632 00000100:00100000:2.0:1782229056.131280:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782229056.131288:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329493632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229056.131329:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329493632:12345-0@lo:400:kworker.0 Request processed in 42us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229056.131335:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782229056.131354:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329493504 00000100:00100000:2.0:1782229056.131357:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329493504 00000100:00100000:2.0:1782229056.131382:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782229056.131388:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329493504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229056.131451:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329493504:12345-0@lo:400:kworker.0 Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229056.131457:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1782229056.131479:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782229056.131484:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782229056.131501:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329493504:0@lo:400:kworker.0 00000100:00100000:2.0:1782229056.131511:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329493632:0@lo:400:kworker.0 00000100:00100000:0.0:1782229056.131712:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe68fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329493760:0@lo:400:kworker.0 00000100:00100000:0.0:1782229056.131743:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229056.132126:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329493760 00000100:00100000:2.0:1782229056.132145:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329493760 00000100:00100000:2.0:1782229056.132200:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1782229056.132356:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329493760:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782229056.132488:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229056.132602:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329493760:12345-0@lo:400:kworker.0 Request processed in 394us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229056.132609:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782229056.133128:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe68fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329493760:0@lo:400:kworker.0 00000100:00100000:0.0:1782229056.638018:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782229056.638044:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329493888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782229056.638132:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229056.638337:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329493888 00000100:00100000:1.0:1782229056.638355:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329493888 00000100:00100000:1.0:1782229056.638406:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782229056.638416:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329493888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782229056.638478:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229056.638541:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329493888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229056.638549:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782229056.638783:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329493888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782229056.894244:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229057.089996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.090042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.090085:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.090112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.090141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.090184:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591808 00000100:00100000:0.0:1782229057.090194:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591808 00000100:00100000:0.0:1782229057.090261:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591680 00000100:00100000:0.0:1782229057.090265:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591680 00000100:00100000:0.0:1782229057.090291:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 84 00000100:00100000:0.0:1782229057.090302:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309591808:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229057.090483:0:12346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00100000:1.0:1782229057.090506:0:12346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309591680:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229057.090539:0:12346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2373:x1868802309591680:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229057.090546:0:12346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00080000:1.0:1782229057.090664:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782229057.090669:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229057.090700:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591552 00000100:00100000:1.0:1782229057.090704:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591552 00000100:00100000:1.0:1782229057.090735:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591936 00000100:00100000:1.0:1782229057.090737:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591936 00000100:00100000:1.0:1782229057.090759:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 173 00000100:00100000:1.0:1782229057.090767:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2373:x1868802309591552:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229057.090800:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:2373:x1868802309591552:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 33us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229057.090807:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 173 00000100:00100000:1.0:1782229057.090819:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 174 00000100:00100000:1.0:1782229057.090826:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:2373:x1868802309591936:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229057.090848:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4188f868-851e-4c26-a016-17a3b5288455+6:2373:x1868802309591936:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 23us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229057.090854:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 174 00000100:00080000:1.0:1782229057.090889:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229057.091077:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2373:x1868802309591808:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 777us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229057.091084:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 84 00000100:00100000:3.0:1782229057.094696:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309591424 00000100:00100000:3.0:1782229057.094709:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309591424 00000100:00100000:3.0:1782229057.094778:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 303 00000100:00100000:3.0:1782229057.094789:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309591424:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229057.094882:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2373:x1868802309591424:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 95us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229057.094890:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 303 00000100:00100000:1.0:1782229057.519511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.519607:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309592192 00000100:00100000:0.0:1782229057.519618:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309592192 00000100:00100000:0.0:1782229057.519683:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:0.0:1782229057.519694:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+18:12325:x1868802309592192:12345-192.168.204.22@tcp:35:umount.0 00000100:00100000:0.0:1782229057.520311:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+19:12325:x1868802309592192:12345-192.168.204.22@tcp:35:umount.0 Request processed in 617us (809us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1782229057.520320:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 66 00000100:00100000:1.0:1782229057.527463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.527640:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309592448 00000100:00100000:0.0:1782229057.527650:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309592448 00000100:00100000:0.0:1782229057.527718:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 67 00000100:00100000:0.0:1782229057.527729:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+19:12325:x1868802309592448:12345-192.168.204.22@tcp:35:umount.0 00000100:00100000:0.0:1782229057.528088:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+20:12325:x1868802309592448:12345-192.168.204.22@tcp:35:umount.0 Request processed in 359us (661us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1782229057.528096:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 67 00000100:00100000:1.0:1782229057.533012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.536325:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309592704 00000100:00100000:0.0:1782229057.536339:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309592704 00000100:00100000:0.0:1782229057.536423:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 68 00000100:00100000:0.0:1782229057.536474:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe42ec5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+20:12325:x1868802309592704:12345-192.168.204.22@tcp:35:umount.0 00000100:00100000:0.0:1782229057.536969:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe42ec5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+21:12325:x1868802309592704:12345-192.168.204.22@tcp:35:umount.0 Request processed in 535us (3966us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1782229057.536978:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 68 00000100:00100000:1.0:1782229057.546527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229057.546700:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309592960 00000100:00100000:0.0:1782229057.546710:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309592960 00000100:00100000:0.0:1782229057.546778:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:0.0:1782229057.546788:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+21:12325:x1868802309592960:12345-192.168.204.22@tcp:35:umount.0 00000100:00100000:0.0:1782229057.550024:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:12325:x1868802309592960:12345-192.168.204.22@tcp:35:umount.0 Request processed in 3224us (3493us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1782229057.550040:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 69 00000100:00100000:1.0:1782229057.561080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229057.561146:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229057.561246:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229057.561730:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309593216 00000100:00100000:3.0:1782229057.561739:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309593216 00000100:00100000:3.0:1782229057.561802:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309593344 00000100:00100000:3.0:1782229057.561806:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309593344 00000100:00100000:0.0:1782229057.561832:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309593088 00000100:00100000:0.0:1782229057.561838:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309593088 00000100:00100000:0.0:1782229057.561867:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:0.0:1782229057.561876:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e285f6c-2f3f-46f5-8113-fe389a782fea+15:2372:x1868802309593216:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782229057.561891:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229057.561908:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b2e00/0x8e1c8a3488e636fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994960e expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.561934:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229057.561986:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e285f6c-2f3f-46f5-8113-fe389a782fea+14:2372:x1868802309593216:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 110us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229057.561990:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:0.0:1782229057.562000:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:2.0:1782229057.562005:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e285f6c-2f3f-46f5-8113-fe389a782fea+14:2370:x1868802309593088:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229057.562016:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229057.562026:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b2600/0x8e1c8a3488e63794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949646 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229057.562038:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229057.562060:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e285f6c-2f3f-46f5-8113-fe389a782fea+13:2370:x1868802309593088:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 60us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229057.562479:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229057.562513:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309593728 00000100:00100000:1.0:1782229057.562517:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309593728 00000100:00100000:1.0:1782229057.562548:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 72 00000100:00100000:1.0:1782229057.562555:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+7:2369:x1868802309593728:12345-192.168.204.22@tcp:9:umount.0 00000020:00000080:1.0:1782229057.562582:0:8488:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63ccd 00000020:00010000:1.0:1782229057.562590:0:8488:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98fe7b8d0800: total 0 00000100:00080000:1.0:1782229057.562595:0:8488:0:(import.c:65:import_set_state_nolock()) ffff98fe74515000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782229057.562633:0:8488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1782229057.562893:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2369:x1868802309593728:12345-192.168.204.22@tcp:9:umount.0 Request processed in 336us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229057.562900:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 72 00000020:00010000:1.0:1782229057.562925:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98fe7b8d0800: total 0 00010000:00010000:1.0:1782229057.562945:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98fe7b8d0800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782229057.562991:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2eb9c4/0x8e1c8a3488e64070 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498e6 expref: 4 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229057.563021:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000392b5046/0x8e1c8a3488e6470e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ab4 expref: 3 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229057.563035:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98fe7b8d0800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1782229057.563046:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229057.563048:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229057.563049:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229057.563623:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:3.0:1782229057.563701:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:3.0:1782229057.563713:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:2373:x1868802309593344:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229057.563736:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229057.563750:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe414a0000/0x8e1c8a3488e639a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949711 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229057.563763:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229057.563802:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2373:x1868802309593344:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 92us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229057.563819:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:1.0:1782229057.579691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229057.582681:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309593856 00000100:00100000:3.0:1782229057.582703:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309593856 00000100:00100000:3.0:1782229057.582939:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 73 00000100:00100000:3.0:1782229057.582955:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+5:2369:x1868802309593856:12345-192.168.204.22@tcp:9:umount.0 00000020:00000080:3.0:1782229057.583002:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63a6c 00000100:00080000:3.0:1782229057.583015:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe452e1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782229057.583066:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1782229057.585133:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229057.587248:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2d74cab1-6977-468d-a933-6ac020ef49f3+2:2369:x1868802309593856:12345-192.168.204.22@tcp:9:umount.0 Request processed in 4286us (7555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229057.587262:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 73 00000100:00100000:1.0:1782229057.619320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229057.619774:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309594880 00000100:00100000:2.0:1782229057.619793:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309594880 00000100:00100000:2.0:1782229057.619940:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 240 00000100:00100000:2.0:1782229057.619950:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+22:2369:x1868802309594880:12345-192.168.204.22@tcp:39:umount.0 00000020:00000080:2.0:1782229057.619990:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63708 00000020:00010000:2.0:1782229057.620005:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98fe819e9800: total 0 00000100:00080000:2.0:1782229057.620010:0:5796:0:(import.c:65:import_set_state_nolock()) ffff98fe7d8b6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782229057.620034:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1782229057.620796:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2d74cab1-6977-468d-a933-6ac020ef49f3+21:2369:x1868802309594880:12345-192.168.204.22@tcp:39:umount.0 Request processed in 832us (1815us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782229057.620805:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 240 00000020:00010000:0.0:1782229057.630142:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98fe819e9800: total 0 00010000:00010000:0.0:1782229057.630692:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98fe819e9800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1782229057.630782:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229057.630787:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229057.630799:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420c00/0x8e1c8a3488e645ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a67 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630823:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229057.630826:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782229057.630830:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e640ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949909 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630845:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:0.0:1782229057.630848:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229057.630853:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe74420e00/0x8e1c8a3488e63f51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949899 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630867:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229057.630871:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782229057.630875:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916400/0x8e1c8a3488e63a42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994973b expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630911:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe58ddd600) 00010000:00010000:0.0:1782229057.630914:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229057.630918:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcca00/0x8e1c8a3488e639ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949726 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630938:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:0.0:1782229057.630941:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229057.630944:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd600/0x8e1c8a3488e64031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498d1 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630954:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98fe439ad000) 00010000:00010000:0.0:1782229057.630956:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782229057.630960:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dccc00/0x8e1c8a3488e6405b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99498df expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630971:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229057.630973:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229057.630975:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e646cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949a9f expref: 13 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630984:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:0.0:1782229057.630986:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229057.630990:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e640d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949902 expref: 12 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.630999:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98fe439ad800) 00010000:00010000:0.0:1782229057.631001:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782229057.631012:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917800/0x8e1c8a3488e646f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949aad expref: 11 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.631029:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98fe43933700) 00010000:00010000:0.0:1782229057.631031:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782229057.631035:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd800/0x8e1c8a3488e63d2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994980d expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.631046:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98fe58ddde00) 00010000:00010000:0.0:1782229057.631048:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229057.631051:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe81dcd000/0x8e1c8a3488e639d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994971f expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.631064:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98fe43933000) 00010000:00010000:0.0:1782229057.631065:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782229057.631068:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23200/0x8e1c8a3488e643cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f99499db expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229057.631080:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98fe819e9800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1782229057.631094:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229057.631096:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229057.631098:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229057.915823:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229058.939709:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782229058.939963:0:11549:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782229058.939969:0:11549:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782229058.940597:0:11549:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1782229058.940605:0:11549:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782229059.964037:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229060.152697:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229060.152763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229060.153155:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309595136 00000100:00100000:0.0:1782229060.153164:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309595136 00000100:00100000:0.0:1782229060.153233:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309595008 00000100:00100000:0.0:1782229060.153237:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309595008 00000100:00100000:0.0:1782229060.153349:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00100000:0.0:1782229060.153363:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:2370:x1868802309595136:12345-192.168.204.22@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782229060.153365:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:3.0:1782229060.153382:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+11:2373:x1868802309595008:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229060.153396:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229060.153396:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229060.153420:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b3400/0x8e1c8a3488e637da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994965b expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229060.153473:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229060.153527:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2373:x1868802309595008:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 152us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229060.153535:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:3.0:1782229060.153625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229060.153687:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309595264 00000100:00100000:3.0:1782229060.153691:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309595264 00000100:00100000:3.0:1782229060.153713:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:3.0:1782229060.153720:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+10:2372:x1868802309595264:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229060.153729:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229060.153740:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b2000/0x8e1c8a3488e637e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949685 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229060.153751:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50917400/0x8e1c8a3488e63985 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994970a expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229060.153755:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782229060.153766:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229060.153790:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:2370:x1868802309595136:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 431us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229060.153796:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e285f6c-2f3f-46f5-8113-fe389a782fea+8:2372:x1868802309595264:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229060.153808:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00100000:3.0:1782229060.157126:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:3.0:1782229060.170330:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229060.170472:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309595520 00000100:00100000:2.0:1782229060.170483:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309595520 00000100:00100000:2.0:1782229060.170559:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 241 00000100:00100000:2.0:1782229060.170569:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+6:2369:x1868802309595520:12345-192.168.204.22@tcp:39:umount.0 00000020:00000080:2.0:1782229060.170609:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e637ef 00000020:00010000:2.0:1782229060.170615:0:5797:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98fe7fe2b000: total 0 00000100:00080000:2.0:1782229060.170620:0:5797:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe2c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782229060.170650:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1782229060.170862:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4188f868-851e-4c26-a016-17a3b5288455+5:2369:x1868802309595520:12345-192.168.204.22@tcp:39:umount.0 Request processed in 293us (548us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1782229060.170870:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 241 00000020:00010000:0.0:1782229060.171052:0:5785:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98fe7fe2b000: total 0 00010000:00010000:0.0:1782229060.171057:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229060.171096:0:5785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98fe7fe2b000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782229060.171138:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9900) 00010000:00010000:0.0:1782229060.171142:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229060.171151:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916c00/0x8e1c8a3488e6471c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949abb expref: 4 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229060.171172:0:5785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98fe7fe2b000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782229060.171182:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229060.171184:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229060.171186:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782229060.171676:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229060.203325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229060.203490:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309595776 00000100:00100000:1.0:1782229060.203502:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309595776 00000100:00100000:1.0:1782229060.203563:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 304 00000100:00100000:1.0:1782229060.203572:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+7:2369:x1868802309595776:12345-192.168.204.22@tcp:251:umount.0 00000020:00000080:1.0:1782229060.203619:0:5790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e636e5 00000020:00010000:1.0:1782229060.203628:0:5790:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98fe7d896800: total 0 00000100:00080000:1.0:1782229060.203632:0:5790:0:(import.c:65:import_set_state_nolock()) ffff98fe7d890000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782229060.203714:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e285f6c-2f3f-46f5-8113-fe389a782fea+3:2369:x1868802309595776:12345-192.168.204.22@tcp:251:umount.0 Request processed in 142us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229060.203722:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 304 00000020:00010000:0.0:1782229060.204029:0:6613:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98fe7d896800: total 0 00010000:00010000:0.0:1782229060.204084:0:6613:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98fe7d896800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782229060.204231:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40030000/0x8e1c8a3488e6379b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f994964d expref: 2 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229060.204247:0:6613:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98fe7d896800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1782229060.204259:0:6613:0:(genops.c:906:class_export_put()) final put ffff98fe7d896800/4e285f6c-2f3f-46f5-8113-fe389a782fea 00010000:00010000:0.0:1782229060.204279:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229060.204296:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229060.204298:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782229060.206729:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7d896800/4e285f6c-2f3f-46f5-8113-fe389a782fea for MGS 00000020:00000080:1.0:1782229060.206982:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7d890000 for MGS 00000001:00100000:2.0:1782229060.261281:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:2.0:1782229060.261291:0:6623:0:(genops.c:906:class_export_put()) final put ffff98fe452e0800/2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:1.0:1782229060.261383:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe452e0800/2d74cab1-6977-468d-a933-6ac020ef49f3 for lustre-OST0000 00000020:00000080:1.0:1782229060.261456:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe452e1800 for lustre-OST0000 00000001:00100000:1.0:1782229060.804638:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:1.0:1782229060.804648:0:7508:0:(genops.c:906:class_export_put()) final put ffff98fe7b8d0800/2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:1.0:1782229060.804674:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7b8d0800/2d74cab1-6977-468d-a933-6ac020ef49f3 for lustre-OST0001 00000020:00000080:1.0:1782229060.804723:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe74515000 for lustre-OST0001 00000001:00080000:3.0:1782229060.845877:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1782229060.845907:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4188f868-851e-4c26-a016-17a3b5288455 00000001:00080000:3.0:1782229060.845914:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1782229060.845917:0:5818:0:(genops.c:906:class_export_put()) final put ffff98fe7fe2b000/4188f868-851e-4c26-a016-17a3b5288455 00000001:00100000:3.0:1782229060.846319:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2d74cab1-6977-468d-a933-6ac020ef49f3 00000001:00080000:3.0:1782229060.846325:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1782229060.846327:0:5818:0:(genops.c:906:class_export_put()) final put ffff98fe819e9800/2d74cab1-6977-468d-a933-6ac020ef49f3 00000020:00000080:0.0:1782229060.846492:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7fe2b000/4188f868-851e-4c26-a016-17a3b5288455 for lustre-MDT0000 00000020:00000080:0.0:1782229060.846548:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819e9800/2d74cab1-6977-468d-a933-6ac020ef49f3 for lustre-MDT0000 00000020:00000080:0.0:1782229060.846582:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7fe2c800 for lustre-MDT0000 00000020:00000080:0.0:1782229060.846587:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7d8b6800 for lustre-MDT0000 00010000:00010000:0.0:1782229060.987658:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229061.243732:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782229061.243756:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329494016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229061.243825:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229061.243928:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494016 00000100:00100000:1.0:1782229061.243936:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494016 00000100:00100000:1.0:1782229061.244000:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782229061.244010:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329494016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782229061.244046:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229061.244103:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329494016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229061.244124:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782229061.244177:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329494016:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782229061.244237:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782229061.244862:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329494144:0@lo:400:kworker.0 00000100:00100000:0.0:1782229061.244907:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229061.245025:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494144 00000100:00100000:2.0:1782229061.245030:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494144 00000100:00100000:2.0:1782229061.245064:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1782229061.245072:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329494144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.245251:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329494400:0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.245285:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229061.245325:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782229061.245331:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe73e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329494272:0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.245352:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229061.245390:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494400 00000100:00100000:3.0:1782229061.245394:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494400 00000100:00100000:3.0:1782229061.245426:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494272 00000100:00100000:3.0:1782229061.245462:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494272 00000100:00100000:3.0:1782229061.245484:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782229061.245491:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329494400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.245530:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329494400:12345-0@lo:400:kworker.0 Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229061.245547:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782229061.245562:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782229061.245568:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329494272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.245598:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329494272:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229061.245604:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1782229061.245626:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229061.245654:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329494272:0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.245664:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe73e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329494400:0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.248837:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329494528:0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.248908:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229061.248967:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494528 00000100:00100000:3.0:1782229061.248974:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494528 00000100:00100000:3.0:1782229061.249025:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782229061.249034:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329494528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.249086:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329494528:12345-0@lo:400:kworker.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229061.249105:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1782229061.249126:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229061.249157:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329494528:0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.249569:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782229061.249579:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329494656:0@lo:400:kworker.0 00000100:00100000:3.0:1782229061.249614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229061.250516:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6606c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3311:x1868802329494144:12345-0@lo:400:kworker.0 Request processed in 5440us (5604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229061.250526:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782229061.254132:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494656 00000100:00100000:1.0:1782229061.254147:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494656 00000100:00100000:1.0:1782229061.254233:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782229061.254244:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329494656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229061.254334:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329494656:12345-0@lo:400:kworker.0 Request processed in 91us (4719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229061.254341:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1782229061.254495:0:5793:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782229061.254560:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329494656:0@lo:400:kworker.0 00000100:00100000:0.0:1782229061.257973:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329494144:0@lo:400:kworker.0 00000100:00100000:1.0:1782229061.755727:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782229061.755754:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329494784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782229061.755826:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229061.755994:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494784 00000100:00100000:0.0:1782229061.756002:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494784 00000100:00100000:0.0:1782229061.756061:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782229061.756070:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329494784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782229061.756115:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229061.756172:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329494784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229061.756180:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782229061.756260:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329494784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782229062.021329:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782229062.103881:0:12839:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782229062.138050:0:12839:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1782229062.138134:0:12839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.138148:0:12839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.138157:0:12839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.138164:0:12839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.138185:0:12839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782229062.138191:0:12839:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782229062.138213:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782229062.138217:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782229062.138223:0:12839:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782229062.138247:0:12839:0:(import.c:65:import_set_state_nolock()) ffff98fe819ea000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782229062.138463:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329494912:0@lo:39:umount.0 00010000:00010000:0.0:1782229062.138495:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229062.138504:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.138514:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe82050e00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782229062.138525:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229062.138534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782229062.138536:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782229062.138546:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782229062.138552:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782229062.138555:0:6613:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782229062.138558:0:6613:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782229062.138586:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.138593:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782229062.138626:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329495040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782229062.138657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229062.138737:0:11530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329495040 00000100:00100000:2.0:1782229062.138744:0:11530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329495040 00000100:00100000:3.0:1782229062.138780:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329494912 00000100:00100000:3.0:1782229062.138787:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329494912 00000100:00100000:2.0:1782229062.138794:0:11530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782229062.138804:0:11530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329495040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782229062.138817:0:11530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782229062.138828:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00010000:00010000:2.0:1782229062.138833:0:11530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40031400/0x8e1c8a3488e63771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e6376a expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229062.138840:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868802329494912:12345-0@lo:39:umount.0 00010000:00010000:2.0:1782229062.138851:0:11530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1782229062.138868:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63502 00000100:00080000:3.0:1782229062.138878:0:5797:0:(import.c:65:import_set_state_nolock()) ffff98fe819d1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782229062.138890:0:11530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3309:x1868802329495040:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229062.138897:0:11530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782229062.138936:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50dc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1868802329494912:12345-0@lo:39:umount.0 Request processed in 99us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229062.138943:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1782229062.138952:0:5797:0:(genops.c:906:class_export_put()) final put ffff98fe819d4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1782229062.138982:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819d4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1782229062.139034:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe819d1800 for lustre-MDT0000 00000100:00100000:1.0:1782229062.139041:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329495040:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1782229062.139083:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe819ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782229062.139099:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329494912:0@lo:39:umount.0 00000100:00080000:2.0:1782229062.139156:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782229062.139159:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782229062.139163:0:12839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782229062.140042:0:12839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140054:0:12839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140062:0:12839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140068:0:12839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140105:0:12839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229062.140112:0:12839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140118:0:12839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140125:0:12839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140131:0:12839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140153:0:12839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782229062.140159:0:12839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140166:0:12839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140170:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782229062.140172:0:12839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140178:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140181:0:12839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140196:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe605b3200 already unused, calling callback (ffffffffc1d50c20) 00010000:00010000:2.0:1782229062.140199:0:12839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782229062.140205:0:12839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229062.140209:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140215:0:12839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140223:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140224:0:12839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229062.140242:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.140248:0:12839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229062.140251:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782229062.140257:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1782229062.140265:0:12839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1782229062.140268:0:12839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1782229062.140277:0:12839:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1782229062.140296:0:12839:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1782229062.140300:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1782229062.140304:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782229062.140309:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1782229062.140314:0:12839:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98fe77b00000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782229062.140319:0:12839:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff98fe7fe6c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782229062.140324:0:12839:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff98fe59f7cd40) has exports, disconnecting them 00000020:00080000:2.0:1782229062.140328:0:12839:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98fe77b00000), last request at 1782229061 00000020:00000080:2.0:1782229062.140333:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63667 00000100:00080000:2.0:1782229062.140346:0:12839:0:(import.c:65:import_set_state_nolock()) ffff98fe77b00800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782229062.140382:0:12839:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98fe77b00000): rc 0 00000020:00000080:2.0:1782229062.140385:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe77b00000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1782229062.140403:0:12839:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98fe7fe6c000), last request at 1782229061 00000020:00000080:2.0:1782229062.140406:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e6359c 00000100:00080000:2.0:1782229062.140411:0:12839:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe6b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782229062.140416:0:12839:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98fe7fe6c000): rc 0 00000020:00000080:2.0:1782229062.140418:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe7fe6c000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1782229062.140424:0:12839:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb64481c9fae0 00000020:00000080:3.0:1782229062.140463:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77b00000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1782229062.140468:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782229062.140472:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1782229062.140488:0:12839:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1782229062.140502:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7fe6c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1782229062.140526:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe77b00800 for lustre-MDT0000 00000020:00000080:3.0:1782229062.140531:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7fe6b800 for lustre-MDT0000 00000100:00080000:2.0:1782229062.140546:0:12839:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1782229062.140564:0:12839:0:(import.c:65:import_set_state_nolock()) ffff98fe7d897000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1782229062.140588:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782229062.140591:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1782229062.140600:0:12839:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1782229062.140601:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140609:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782229062.140629:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140636:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe605b3200/0x8e1c8a3488e63778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e6377f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140647:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782229062.140650:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140655:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe53378e00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229062.140658:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782229062.140662:0:12839:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00010000:00010000:1.0:1782229062.140665:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782229062.140673:0:12839:0:(import.c:65:import_set_state_nolock()) ffff98fe77a81800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 10000000:00010000:1.0:1782229062.140684:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229062.140691:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1782229062.140694:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1782229062.140696:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1782229062.140717:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140723:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1782229062.140726:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98fe59f7cd40) has no exports 00010000:00010000:1.0:1782229062.140730:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140737:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe53378e00/0x8e1c8a3488e6369f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e636a6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140750:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782229062.140753:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140759:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc800 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229062.140761:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140767:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229062.140772:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229062.140786:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1782229062.140788:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1782229062.140790:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1782229062.140802:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.140806:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782229062.140856:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329495168:0@lo:9:umount.0 00000100:00100000:3.0:1782229062.140909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229062.140944:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329495424:0@lo:9:umount.0 00000100:00100000:3.0:1782229062.140967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782229062.141853:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.141866:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82050e00/0x8e1c8a3488e6376a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e63771 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.141878:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229062.141882:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.141888:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782229062.141891:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.141899:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782229062.141929:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782229062.141942:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1782229062.141945:0:6613:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1782229062.141948:0:6613:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1782229062.141972:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.141979:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782229062.142532:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329495808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229062.142588:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329495168 00000100:00100000:3.0:1782229062.142593:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229062.142598:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329495168 00000100:00100000:3.0:1782229062.142640:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782229062.142648:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329495680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229062.142664:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329495424 00000100:00100000:2.0:1782229062.142669:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329495424 00000100:00100000:3.0:1782229062.142674:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229062.142703:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782229062.142709:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329495808 00000100:00100000:3.0:1782229062.142714:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329495808 00000100:00100000:2.0:1782229062.142715:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe73e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1868802329495168:12345-0@lo:9:umount.0 00000020:00000080:2.0:1782229062.142743:0:8488:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e635e9 00000100:00100000:3.0:1782229062.142750:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329495680 00000100:00080000:2.0:1782229062.142752:0:8488:0:(import.c:65:import_set_state_nolock()) ffff98fe7d891800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782229062.142762:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329495680 00000100:00100000:3.0:1782229062.142785:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000001:00000004:2.0:1782229062.142788:0:8488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1782229062.142794:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+19:3309:x1868802329495808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782229062.142806:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229062.142821:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe605b3800/0x8e1c8a3488e6345a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63453 expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229062.142837:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229062.142873:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+18:3309:x1868802329495808:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229062.142881:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782229062.142900:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782229062.142908:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3309:x1868802329495680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782229062.142917:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229062.142925:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe74421600/0x8e1c8a3488e639a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e6399a expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229062.142934:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229062.142960:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3309:x1868802329495680:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229062.142968:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782229062.142989:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782229062.142998:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1868802329495424:12345-0@lo:9:umount.0 00000020:00000080:3.0:1782229062.143014:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e636d0 00000100:00080000:3.0:1782229062.143021:0:6600:0:(import.c:65:import_set_state_nolock()) ffff98fe77bcf800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782229062.143045:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1782229062.143324:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7be3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3307:x1868802329495424:12345-0@lo:9:umount.0 Request processed in 328us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229062.143342:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782229062.143357:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe73e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3307:x1868802329495168:12345-0@lo:9:umount.0 Request processed in 642us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229062.143366:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782229062.143391:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329495680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782229062.143400:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3309:1868802329495808:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1782229062.143456:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7d897000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1782229062.143463:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1782229062.143466:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782229062.143469:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329495168:0@lo:9:umount.0 00000100:00080000:3.0:1782229062.143482:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe77a81800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1782229062.143485:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1782229062.143487:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782229062.143489:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329495424:0@lo:9:umount.0 00000100:00100000:2.0:1782229062.145476:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329495552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229062.145541:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229062.145591:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782229062.145598:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329495296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229062.145621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782229062.145671:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229062.145684:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329495552 00000100:00100000:2.0:1782229062.145690:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329495552 00000100:00100000:2.0:1782229062.145730:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329495296 00000100:00100000:2.0:1782229062.145733:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329495296 00000100:00100000:2.0:1782229062.145748:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782229062.145756:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+17:3311:x1868802329495552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782229062.145767:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229062.145782:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82051800/0x8e1c8a3488e636a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e6369f expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.145822:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229062.145856:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+16:3311:x1868802329495552:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229062.145862:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782229062.145876:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782229062.145882:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+15:3311:x1868802329495296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782229062.145888:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229062.145897:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82050400/0x8e1c8a3488e6377f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63778 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229062.145905:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229062.145925:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9dd69a8-6985-42fa-86d8-1fd8a4966144+14:3311:x1868802329495296:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229062.145930:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782229062.145961:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329495296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229062.145969:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329495552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782229062.148806:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.148823:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe40031e00/0x8e1c8a3488e63453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e6345a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229062.148843:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229062.148845:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229062.148848:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229062.151002:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.151018:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc800/0x8e1c8a3488e6399a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e639a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.151032:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229062.151034:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229062.151036:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1782229062.158880:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff98fe59f7cd40) has no exports 00000020:00000080:2.0:1782229062.232124:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e634ae 00000020:00000080:2.0:1782229062.232139:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe819d6800/lustre-QMT0000_UUID 00000020:01000000:2.0:1782229062.232163:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1782229062.232393:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819d6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1782229062.232451:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.232461:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782229062.232466:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff98fe74e399c0) has no exports 00000020:00000080:3.0:1782229062.232714:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e634a7 00000020:00000080:3.0:1782229062.232722:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe74e2d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782229062.232780:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.232787:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782229062.232790:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe74e28000/lustre-QMT0000_UUID 00000020:00000080:3.0:1782229062.232792:0:12839:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe74e28000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1782229062.232796:0:12839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1782229062.232958:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe74e2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782229062.234303:0:12839:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fd41cdf780 - data ffff98fe77e58bd0/ffff98fe77b7f800 00000020:01000000:3.0:1782229062.234554:0:12839:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fe445d8a80 - data ffff98fe723d7000/ffff98fe819da800 00000001:00000004:3.0:1782229062.250351:0:12839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1782229062.307237:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782229062.307246:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1782229062.307341:0:12839:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782229062.307345:0:12839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1782229062.307697:0:6962:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1782229062.307704:0:6962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1782229062.307727:0:6962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1782229062.308616:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782229062.308625:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1782229062.308645:0:12839:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782229062.308648:0:12839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782229062.308865:0:7531:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782229062.308868:0:7531:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1782229062.308876:0:7531:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1782229062.353953:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63476 00000020:00000080:3.0:1782229062.353971:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe819ec800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782229062.355232:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e6348b 00000020:00000080:3.0:1782229062.355240:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe42f2a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782229062.355247:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1782229062.355251:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.355258:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782229062.355262:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff98fe59f78000) has no exports 00000004:01000000:3.0:1782229062.355415:0:12839:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1782229062.355424:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e636c9 00000020:00000080:3.0:1782229062.355446:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe77a81000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782229062.355451:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782229062.355455:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.355461:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782229062.355463:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff98fe7fff8000) has no exports 00000020:00000080:3.0:1782229062.355468:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e636c2 00000020:00000080:3.0:1782229062.355473:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe77a82800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1782229062.355919:0:12839:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782229062.355924:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782229062.355928:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1782229062.355935:0:12839:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782229062.355937:0:12839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782229062.355972:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.355979:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782229062.355983:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e635e2 00000020:00000080:3.0:1782229062.355988:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe7d8b5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782229062.355991:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782229062.355994:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.355997:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782229062.356000:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff98fe7fffb380) has no exports 00000020:00000080:3.0:1782229062.356004:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e635db 00000020:00000080:3.0:1782229062.356015:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe7fe6b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782229062.356526:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782229062.356539:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe42f2a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1782229062.356548:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77a81000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782229062.356552:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77a82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782229062.356559:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe77a81800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782229062.356564:0:37:0:(genops.c:906:class_export_put()) final put ffff98fd42a3a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782229062.356566:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fd42a3a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1782229062.356570:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782229062.356635:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7d8b5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782229062.356639:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7fe6b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1782229062.357369:0:12839:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782229062.357374:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782229062.357377:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1782229062.357382:0:12839:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782229062.357384:0:12839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782229062.357426:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.357481:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782229062.357510:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.357512:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782229062.357516:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe819e8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782229062.357519:0:12839:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819e8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1782229062.357524:0:12839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782229062.357653:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63492 00000020:00000080:3.0:1782229062.357657:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe42f29800/lustre-MDD0000_UUID 00000020:01000000:3.0:1782229062.357661:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1782229062.357664:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.357667:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782229062.357670:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff98fe59f799c0) has no exports 00000020:00000080:3.0:1782229062.357686:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.357689:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1782229062.357692:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63499 00000020:00000080:3.0:1782229062.357695:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe42f2f800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782229062.357701:0:12839:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fe50300000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1782229062.357704:0:12839:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe50300000 3 00000020:01000004:3.0:1782229062.357706:0:12839:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98fe50300000 from lustre-MDT0000 00000020:00000080:3.0:1782229062.357724:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.357726:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1782229062.357729:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe819eb000/lustre-MDT0000_UUID 00000020:00000080:3.0:1782229062.357731:0:12839:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819eb000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1782229062.357737:0:12839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1782229062.357760:0:12839:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1782229062.357771:0:12839:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1782229062.357774:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1782229062.357777:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.357779:0:12839:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782229062.357785:0:12839:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff98fe65f18000 c9dd69a8-6985-42fa-86d8-1fd8a4966144 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782229062.357790:0:12839:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff98fe68ea19c0) has exports, disconnecting them 00000020:00080000:3.0:1782229062.357793:0:12839:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98fe65f18000), last request at 1782228840 00000020:00000080:3.0:1782229062.357805:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63437 00000020:00010000:3.0:1782229062.357808:0:12839:0:(genops.c:1942:obd_stale_export_put()) Put export ffff98fe65f18000: total 2 00000100:00080000:3.0:1782229062.357811:0:12839:0:(import.c:65:import_set_state_nolock()) ffff98fe65f1a000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1782229062.357886:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7d897000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782229062.357892:0:37:0:(genops.c:906:class_export_put()) final put ffff98fe7fe69000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782229062.357894:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7fe69000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1782229062.357898:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782229062.357966:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe42f29800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1782229062.357969:0:37:0:(genops.c:906:class_export_put()) final put ffff98fe819ec000/lustre-MDD0000_UUID 00000020:00000080:2.0:1782229062.357970:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819ec000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1782229062.357974:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1782229062.358146:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe42f2f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1782229062.358590:0:12839:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98fe65f18000): rc 0 00000020:00080000:3.0:1782229062.358597:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff98fe68ea19c0) has no exports 00000100:00100000:2.0:1782229062.358719:0:5791:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98fe446a4c00:5791] 1 exiting: rc = 0 00000100:00100000:2.0:1782229062.358799:0:5792:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98fe446a4400:5792] 2 exiting: rc = 0 00000020:00010000:1.0:1782229062.359147:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff98fe65f18000: total 0 00010000:00010000:1.0:1782229062.359182:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff98fe65f18000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1782229062.359207:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82051600/0x8e1c8a3488e6378d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63786 expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359222:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe53379800/0x8e1c8a3488e6354f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63548 expref: 8 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359236:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82050800/0x8e1c8a3488e63739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63732 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359259:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe82051e00/0x8e1c8a3488e63747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63740 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359277:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50916200/0x8e1c8a3488e63755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e6374e expref: 5 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359291:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e63993 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e6398c expref: 4 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359300:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40031000/0x8e1c8a3488e63763 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e6375c expref: 3 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359312:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe81dcd200/0x8e1c8a3488e6397e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8e1c8a3488e63977 expref: 2 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229062.359324:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff98fe65f18000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1782229062.359336:0:5784:0:(genops.c:906:class_export_put()) final put ffff98fe65f18000/c9dd69a8-6985-42fa-86d8-1fd8a4966144 00010000:00010000:1.0:1782229062.359348:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229062.359350:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229062.359352:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229062.359379:0:5790:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98fe50d39600:5790] 0 exiting: rc = 1 00000020:00000080:1.0:1782229062.359417:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe65f18000/c9dd69a8-6985-42fa-86d8-1fd8a4966144 for MGS 00000020:00000080:1.0:1782229062.359467:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe65f1a000 for MGS 00000100:00100000:3.0:1782229062.359654:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359661:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359666:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359672:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359677:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359681:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359686:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359691:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359697:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359703:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359708:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359713:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359718:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359723:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359727:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359733:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359737:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359743:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359748:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359754:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359758:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359772:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359778:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359783:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359789:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359795:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359800:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359806:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359811:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359816:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359822:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359828:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359834:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359839:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359844:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359850:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359856:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359862:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359867:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359873:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359879:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359885:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359891:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359897:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359901:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359906:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359912:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359917:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359922:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359927:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359933:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359939:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359945:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359951:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359956:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359961:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359973:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359979:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359983:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359989:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359994:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.359999:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.360004:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229062.360009:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1782229062.360867:0:12839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782229062.360879:0:12839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1782229062.361609:0:12839:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fd41cdf960 - data ffff98fe4e257ca8/ffff98fe77b6f400 00000020:01000000:3.0:1782229062.361701:0:12839:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fe50287180 - data ffff98fe4e016288/ffff98fe503e9c00 00000020:00000080:3.0:1782229062.362180:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e6341b 00000020:00000080:3.0:1782229062.362187:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe58161000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782229062.362246:0:12839:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fe50300000 from MGS, refs=2 00000020:01000004:3.0:1782229062.362249:0:12839:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe50300000 2 00000020:01000004:3.0:1782229062.362252:0:12839:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98fe50300000 from MGS 00000020:00000080:3.0:1782229062.362285:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.362292:0:12839:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1782229062.362295:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe68fb8800/MGS 00000020:00000080:3.0:1782229062.362298:0:12839:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe68fb8800/MGS for MGS 00000020:01000000:3.0:1782229062.362306:0:12839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1782229062.362360:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1782229062.362364:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.362369:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782229062.362377:0:12839:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98fe819ef800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782229062.362382:0:12839:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff98fe66023380) has exports, disconnecting them 00000020:00080000:3.0:1782229062.362385:0:12839:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98fe819ef800), last request at 1782228841 00000020:00000080:3.0:1782229062.362389:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e634e6 00000020:00080000:3.0:1782229062.362395:0:12839:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98fe819ef800): rc 0 00000020:00000080:3.0:1782229062.362400:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe819ef800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1782229062.362804:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe58161000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782229062.363352:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819ef800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1782229062.363642:0:12839:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1782229062.363656:0:12839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782229062.363660:0:12839:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782229062.363665:0:12839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782229062.363819:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229062.363826:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1782229062.363830:0:12839:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe50300000 1 00000020:00000080:3.0:1782229062.363835:0:12839:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e6340d 00000020:00000080:3.0:1782229062.363840:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe68fbd800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782229062.364146:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe819ea000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1782229062.364152:0:36:0:(genops.c:906:class_export_put()) final put ffff98fe42f2f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1782229062.364155:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe42f2f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1782229062.364166:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1782229062.364250:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1782229062.364255:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229062.364258:0:12839:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782229062.364261:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff98fe68ea4d40) has no exports 00000020:00000080:1.0:1782229062.364481:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe68fbd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782229062.394569:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782229062.394584:0:12839:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1782229062.394590:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe68fbe800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782229062.394595:0:12839:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe68fbe800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1782229062.394608:0:12839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1782229062.394762:0:12839:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff98fe4556a000 00000020:01000000:1.0:1782229062.394783:0:12839:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1782229062.394787:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782229062.394791:0:12839:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782229062.394795:0:12839:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff98fe59f7b380) has no exports 00000100:00100000:1.0:1782229062.394864:0:5796:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98fe58d09e00:5796] 0 exiting: rc = 1 00000100:00100000:3.0:1782229062.396215:0:5797:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98fe58d08e00:5797] 1 exiting: rc = 0 00000100:00100000:2.0:1782229062.398017:0:10359:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98fe77b49e00:10359] 3 exiting: rc = 0 00000100:00100000:2.0:1782229062.398113:0:5798:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98fe4476ea00:5798] 2 exiting: rc = 0 00000100:00100000:1.0:1782229062.398248:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398255:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398261:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398266:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398279:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398285:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398291:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398296:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398302:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398307:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398312:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398317:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398323:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398328:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398334:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398343:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398351:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398356:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398361:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398368:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398383:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398389:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398394:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398399:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398404:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398408:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398416:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398421:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398425:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398449:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398455:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398460:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398465:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398470:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398475:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398480:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398484:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398490:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398586:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398593:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398599:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398604:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398608:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398613:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398618:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398622:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398628:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398633:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398637:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398642:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398646:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398650:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398658:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398663:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398668:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398679:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398684:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398688:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398693:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398698:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398703:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398707:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398712:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.398726:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782229062.402971:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98fe4476e000:5800] 1 exiting: rc = 0 00000100:00100000:0.0:1782229062.403325:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98fe4476f200:5799] 0 exiting: rc = 1 00000100:00100000:1.0:1782229062.403774:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403784:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403790:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403796:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403802:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403809:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403815:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403821:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403827:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403833:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403841:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403847:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403855:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403860:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403865:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403871:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403877:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403883:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403888:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403970:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403980:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403986:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403993:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.403998:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404003:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404008:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404022:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404029:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404034:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404039:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404045:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404050:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404055:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404060:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404066:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404224:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404230:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404234:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404239:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404243:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404247:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404252:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404256:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404261:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404266:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404371:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404376:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404381:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404386:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404391:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404396:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404400:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404405:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404409:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404413:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404418:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404423:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404523:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404531:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404536:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404541:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404555:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404561:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.404567:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782229062.407624:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98fe4463b800:5802] 1 exiting: rc = 0 00000100:00100000:0.0:1782229062.407881:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98fe4463b400:5801] 0 exiting: rc = 1 00000100:00100000:1.0:1782229062.407933:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.407941:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.407968:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.407975:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.407981:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408017:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408024:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408029:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408035:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408041:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408047:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408053:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408058:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408064:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408092:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408099:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408105:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408111:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408118:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408123:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408129:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408135:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408141:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408146:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408153:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408159:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408187:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408195:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408200:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408207:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408213:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408219:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408236:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408242:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408248:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408254:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408259:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408266:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408357:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408365:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408370:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408376:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408382:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408388:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408394:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408400:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408406:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408412:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408418:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408424:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408552:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408560:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408566:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408572:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408579:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408585:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408591:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408598:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408604:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408610:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408616:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408623:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408643:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.408651:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782229062.416694:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98fe42f41000:5803] 0 exiting: rc = 1 00000100:00100000:1.0:1782229062.416815:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98fe42f41200:5804] 1 exiting: rc = 0 00000100:00100000:1.0:1782229062.416870:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416877:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416894:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416900:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416906:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416911:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416916:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416921:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416927:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416932:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416936:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416941:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416946:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416951:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416956:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416962:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416967:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416972:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416978:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416983:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416989:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.416994:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417000:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417005:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417010:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417014:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417019:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417024:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417029:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417034:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417039:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417043:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417048:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417053:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417059:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417064:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417080:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417094:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417099:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417104:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417109:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417114:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417119:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417125:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417129:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417133:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417138:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417143:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417148:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417152:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417157:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417162:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417168:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417242:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417248:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417253:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417259:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417264:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417340:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417348:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417353:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417358:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417364:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417369:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782229062.417823:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98fe42f40c00:5806] 1 exiting: rc = 0 00000100:00100000:1.0:1782229062.417900:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98fe42f40e00:5805] 0 exiting: rc = 1 00000100:00100000:1.0:1782229062.417946:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417952:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417957:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417961:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417967:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417972:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417978:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417993:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.417998:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418003:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418008:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418012:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418017:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418022:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418027:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418032:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418037:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418042:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418047:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418051:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418056:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418060:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418077:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418083:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418088:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418093:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418099:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418105:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418110:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418115:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418120:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418125:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418130:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418134:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418138:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418144:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418149:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418153:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418159:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418165:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418238:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418246:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418258:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418262:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418337:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418345:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418350:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418356:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418361:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418366:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418372:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418376:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418381:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418386:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418390:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418394:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418399:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418404:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418409:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418413:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418418:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418423:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418547:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.418554:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782229062.418948:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98fe42f41800:5808] 1 exiting: rc = 0 00000100:00100000:1.0:1782229062.419036:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98fe42f41400:5807] 0 exiting: rc = 1 00000100:00100000:1.0:1782229062.419123:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419129:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419135:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419140:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419144:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419149:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419155:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419160:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419165:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419239:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419247:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419252:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419265:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419411:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419421:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419446:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419457:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419468:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419475:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419486:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419494:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419499:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419503:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419514:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419519:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419523:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419528:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419532:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419537:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419542:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419546:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419551:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419555:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419560:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419565:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419570:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419574:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419579:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419583:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419588:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419592:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419596:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419600:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419605:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419610:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419614:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419619:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419632:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419637:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419642:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419647:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419652:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419664:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419670:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419675:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419679:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419684:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419689:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419694:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419700:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419705:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419710:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419715:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.419720:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.420409:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98fe6dd6d600:5810] 1 exiting: rc = 0 00000100:00100000:1.0:1782229062.420619:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98fe6dd6ca00:5811] 2 exiting: rc = 0 00000100:00100000:2.0:1782229062.420947:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98fe44611c00:5809] 0 exiting: rc = 1 00000100:00100000:1.0:1782229062.421080:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421088:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421094:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421099:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421104:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421109:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421115:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421120:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421125:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421131:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421137:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421142:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421148:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421153:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421159:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421165:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421255:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421262:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421337:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421358:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421365:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421371:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421377:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421383:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421389:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421395:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421401:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421408:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421413:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421420:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421458:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421465:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421471:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421476:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421481:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421488:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421493:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421498:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421503:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421508:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421513:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421517:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421522:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421544:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421550:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421556:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421561:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421570:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421575:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421580:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421585:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421598:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421602:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421608:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421614:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421620:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421626:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421632:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421638:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421644:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421650:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421655:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421662:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229062.421668:0:12839:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1782229062.426111:0:12839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782229062.426126:0:12839:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1782229062.426133:0:12839:0:(genops.c:906:class_export_put()) final put ffff98fe58072800/MDS_uuid 00000020:00000080:1.0:1782229062.426138:0:12839:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe58072800/MDS_uuid for MDS 00000020:01000000:1.0:1782229062.426144:0:12839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1782229062.426553:0:12839:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1782229063.058719:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229064.059781:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229065.085944:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782229065.437312:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782229065.437322:0:6623:0:(genops.c:906:class_export_put()) final put ffff98fe7d892800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782229065.437446:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7d892800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1782229065.437499:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7d891800 for lustre-OST0000 00000020:01000004:0.0:1782229065.512751:0:12993:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782229065.526573:0:12993:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1782229065.526633:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229065.526650:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229065.526673:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229065.526680:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229065.526698:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782229065.526704:0:12993:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1782229065.526727:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782229065.526732:0:12993:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782229065.526737:0:12993:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782229065.526776:0:12993:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe2e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782229065.526893:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1868802329495936:0@lo:39:umount.0 00000400:00000100:1.0:1782229065.526948:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868802329495936 offset 0 length 224: 4 00010000:00010000:3.0:1782229065.527375:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229065.527382:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229065.527390:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030c00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:3.0:1782229065.527394:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229065.527403:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782229065.527411:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782229065.527417:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782229065.527420:0:6613:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782229065.527517:0:6613:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782229065.527547:0:6613:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229065.527554:0:6613:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782229065.527594:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1782229065.527612:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229065.527620:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe40030c00/0x8e1c8a3488e6374e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8e1c8a3488e63755 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229065.527631:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229065.527633:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229065.527635:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229065.529537:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329496064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229065.529608:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229065.529712:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329496064 00000100:00100000:0.0:1782229065.529720:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329496064 00000100:00100000:0.0:1782229065.529762:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782229065.529770:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe503fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1868802329496064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782229065.529777:0:5781:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782229065 with bad export cookie 10240211610973385783 00000100:00100000:2.0:1782229065.551329:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe503fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1868802329496064:12345-0@lo:103:ldlm_bl.0 Request processed in 21548us (21710us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782229065.551345:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782229065.551646:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782229065.551651:0:3311:0:(import.c:65:import_set_state_nolock()) ffff98fe58071800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1782229065.551655:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1782229065.563482:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.122@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1782229065.563489:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1782229065.563500:0:3311:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff98fe77c09c00 x1868802329496064/t0(0) o103->MGC192.168.204.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782229081 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1782229065.563513:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1782229065.563515:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1782229065.563546:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1782229065.563550:0:3311:0:(import.c:65:import_set_state_nolock()) ffff98fe58071800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782229065.563555:0:3311:0:(import.c:512:import_select_connection()) MGC192.168.204.122@tcp: connect to NID 0@lo last attempt 153 00000100:00080000:0.0:1782229065.563566:0:3311:0:(import.c:626:import_select_connection()) MGC192.168.204.122@tcp: import ffff98fe58071800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:3.0:1782229065.564198:0:3311:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe77c09180 x1868802329496192/t0(0) o250->MGC192.168.204.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782229065.564236:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3311:1868802329496064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782229065.564459:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3307:1868802329496192:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1782229065.564514:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868802329496192 offset 0 length 520: 4 00000001:00100000:3.0:1782229065.932469:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782229065.932478:0:7508:0:(genops.c:906:class_export_put()) final put ffff98fe77bcc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782229065.932504:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77bcc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1782229065.932544:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe77bcf800 for lustre-OST0001 00010000:00010000:0.0:1782229066.107623:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782229066.363561:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782229066.363571:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782229066.363700:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782229066.363734:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329496320:0@lo:400:kworker.0 00000400:00000100:2.0:1782229066.363791:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868802329496320 offset 0 length 224: 4 00010000:00010000:3.0:1782229067.133746:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229068.155974:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229069.180990:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229070.218867:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782229070.395818:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782229070.395828:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782229070.395967:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782229070.395990:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329496448:0@lo:400:kworker.0 00000400:00000100:3.0:1782229070.396056:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868802329496448 offset 0 length 224: 4 00010000:00010000:3.0:1782229071.227649:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229072.251766:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229073.275688:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229074.299662:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229075.069089:0:3307:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229065/real 1782229065] req@ffff98fe77c09180 x1868802329496192/t0(0) o250->MGC192.168.204.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782229075 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229075.069123:0:3307:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98fe77c09180 x1868802329496192/t0(0) o250->MGC192.168.204.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782229075 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229075.069134:0:3307:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229065/real 1782229065] req@ffff98fd42a36a00 x1868802329495936/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782229075 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229075.069150:0:3307:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98fd42a36a00 x1868802329495936/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782229075 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782229075.069168:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe58071800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782229075.069195:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1782229075.069199:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3307:1868802329496192:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1782229075.069206:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782229075.069229:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1868802329495936:0@lo:39:umount.0 00000100:00080000:0.0:1782229075.069251:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782229075.069258:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1782229075.069261:0:37:0:(import.c:65:import_set_state_nolock()) ffff98fe58071800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782229075.069268:0:37:0:(import.c:512:import_select_connection()) MGC192.168.204.122@tcp: connect to NID 0@lo last attempt 378 00000100:00080000:0.0:1782229075.069274:0:37:0:(import.c:591:import_select_connection()) MGC192.168.204.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782229075.069291:0:37:0:(import.c:626:import_select_connection()) MGC192.168.204.122@tcp: import ffff98fe58071800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782229075.069333:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fd42a35c00 x1868802329496576/t0(0) o250->MGC192.168.204.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782229075.069462:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329496704:0@lo:400:kworker.0 00000400:00000100:2.0:1782229075.069519:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868802329496704 offset 0 length 224: 4 00000100:00080000:1.0:1782229075.069549:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782229075.069555:0:12993:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782229075.069560:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1782229075.069734:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3307:1868802329496576:0@lo:250:kworker.0 00000400:00000100:3.0:1782229075.069760:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868802329496576 offset 0 length 520: 4 00010000:00010000:1.0:1782229075.072004:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072041:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072049:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072056:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072077:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229075.072084:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072090:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072096:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072101:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229075.072126:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782229075.072131:0:12993:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1782229075.072155:0:12993:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1782229075.072159:0:12993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1782229075.072164:0:12993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782229075.072169:0:12993:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782229075.072174:0:12993:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98fe77bc0000) has no exports 00000020:00080000:1.0:1782229075.072201:0:12993:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff98fe77bc0000) has no exports 00010000:00010000:3.0:1782229075.072672:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782229075.072682:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072691:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917600 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:3.0:1782229075.072695:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072706:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782229075.072722:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782229075.072729:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782229075.072731:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1782229075.072734:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1782229075.072750:0:5784:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98fe58071800 00010000:00010000:3.0:1782229075.072754:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072760:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe50917600/0x8e1c8a3488e6375c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63763 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072773:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229075.072776:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072782:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcce00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:3.0:1782229075.072784:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072790:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782229075.072796:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782229075.072800:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782229075.072802:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782229075.072811:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782229075.072816:0:5784:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98fe58071800 00010000:00010000:3.0:1782229075.072832:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072837:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe81dcce00/0x8e1c8a3488e6398c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63993 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229075.072847:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229075.072849:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229075.072850:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229075.074297:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782229075.077525:0:12993:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fe74e58960 - data ffff98fe81237af8/ffff98fd41ab0c00 00000020:01000000:1.0:1782229075.077644:0:12993:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fe69153ae0 - data ffff98fe723390d8/ffff98fe77ab4000 00100000:10000000:1.0:1782229075.089858:0:12993:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1782229075.126022:0:12993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e6356b 00000020:00000080:2.0:1782229075.126034:0:12993:0:(genops.c:906:class_export_put()) final put ffff98fe77bcd000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1782229075.126088:0:12993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fe7b8d6000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1782229075.126092:0:12993:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe7b8d6000 2 00000020:01000004:2.0:1782229075.126095:0:12993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98fe7b8d6000 from lustre-OST0000 00000020:00000080:2.0:1782229075.126121:0:12993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782229075.126132:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1782229075.126135:0:12993:0:(genops.c:906:class_export_put()) final put ffff98fe77bc9800/lustre-OST0000_UUID 00000020:00000080:2.0:1782229075.126138:0:12993:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77bc9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1782229075.126146:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1782229075.126197:0:12993:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1782229075.126202:0:12993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1782229075.126221:0:12993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782229075.126226:0:12993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782229075.126233:0:12993:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98fe7d8b0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782229075.126239:0:12993:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff98fe66020000) has exports, disconnecting them 00000020:00080000:2.0:1782229075.126243:0:12993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98fe7d8b0000), last request at 1782228855 00000020:00000080:2.0:1782229075.126247:0:12993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63595 00000020:00080000:2.0:1782229075.126256:0:12993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98fe7d8b0000): rc 0 00000020:00000080:2.0:1782229075.126262:0:12993:0:(genops.c:906:class_export_put()) final put ffff98fe7d8b0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782229075.127204:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77bcd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782229075.128673:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7d8b0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1782229075.129142:0:12993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1782229075.129148:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782229075.129152:0:12993:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782229075.129158:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782229075.129257:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7fe2e000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1782229075.129343:0:12993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782229075.129352:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1782229075.129357:0:12993:0:(genops.c:906:class_export_put()) final put ffff98fe7fe29800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1782229075.129370:0:12993:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7fe29800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1782229075.129394:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1782229075.129465:0:12993:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe7b8d6000 1 00000020:00000080:0.0:1782229075.129476:0:12993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63525 00000020:00000080:0.0:1782229075.129485:0:12993:0:(genops.c:906:class_export_put()) final put ffff98fe7b63f800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1782229075.130956:0:12993:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1782229075.130992:0:12993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782229075.130999:0:12993:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782229075.131003:0:12993:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff98fe74e3b380) has no exports 00000020:00000080:1.0:1782229075.131184:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7b63f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782229075.165344:0:12993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782229075.165359:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1782229075.165481:0:12993:0:(genops.c:906:class_export_put()) final put ffff98fe7b8d5000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1782229075.165487:0:12993:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7b8d5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1782229075.165572:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1782229075.166591:0:12993:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff98fe7b8d3000 00000020:02000400:1.0:1782229075.166639:0:12993:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1782229075.324076:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229076.348869:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229077.373274:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782229078.187087:0:13147:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782229078.202795:0:13147:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1782229078.202878:0:13147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229078.202891:0:13147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229078.202899:0:13147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229078.202906:0:13147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229078.202928:0:13147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782229078.202935:0:13147:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1782229078.203230:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229078.203237:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229078.203245:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916600 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229078.203249:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229078.203259:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229078.203267:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229078.203284:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782229078.203286:0:6613:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1782229078.203289:0:6613:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782229078.203301:0:6613:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98fe58071800 00010000:00010000:1.0:1782229078.203305:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229078.203312:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe50916600/0x8e1c8a3488e63732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63739 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229078.203323:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229078.203325:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229078.203327:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782229078.203354:0:13147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782229078.203368:0:13147:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff98fd42a34700 x1868802329496320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229082 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782229078.203463:0:13147:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff98fd42a34a80 x1868802329496448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229086 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782229078.203481:0:13147:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff98fd42a36300 x1868802329496704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229091 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782229078.203497:0:13147:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782229078.203503:0:13147:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782229078.203528:0:13147:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe6a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782229078.203596:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1868802329496832:0@lo:39:umount.0 00000400:00000100:1.0:1782229078.203718:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868802329496832 offset 0 length 224: 4 00000100:00100000:0.0:1782229078.203844:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329496704:0@lo:400:kworker.0 00000100:00100000:0.0:1782229078.203853:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329496448:0@lo:400:kworker.0 00000100:00100000:3.0:1782229078.204030:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329496320:0@lo:400:kworker.0 00010000:00010000:1.0:1782229078.396309:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229079.419651:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782229080.187940:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782229080.187952:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1782229080.444735:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229081.472997:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229082.492206:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229083.516877:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229084.539695:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782229085.308999:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782229085.309010:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1782229085.563773:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229086.588003:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229087.620445:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229088.445259:0:3307:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229078/real 1782229078] req@ffff98fe6ee39180 x1868802329496832/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782229088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229088.445297:0:3307:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98fe6ee39180 x1868802329496832/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782229088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782229088.445316:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7fe6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782229088.445339:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1868802329496832:0@lo:39:umount.0 00000100:00080000:2.0:1782229088.445467:0:13147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782229088.445472:0:13147:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782229088.445477:0:13147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782229088.446535:0:13147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446550:0:13147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446568:0:13147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446576:0:13147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446609:0:13147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229088.446616:0:13147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446622:0:13147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446627:0:13147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446647:0:13147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.446665:0:13147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1782229088.446670:0:13147:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1782229088.446691:0:13147:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1782229088.446695:0:13147:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1782229088.446700:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782229088.446705:0:13147:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782229088.446709:0:13147:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98fe74e38000) has no exports 00000020:00080000:2.0:1782229088.446731:0:13147:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff98fe74e38000) has no exports 00010000:00010000:1.0:1782229088.447013:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782229088.447021:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447028:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229088.447038:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447047:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229088.447054:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229088.447060:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782229088.447062:0:6613:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1782229088.447065:0:6613:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1782229088.447077:0:6613:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98fe58071800 00010000:00010000:1.0:1782229088.447081:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447087:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e63740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e63747 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447100:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229088.447104:0:6613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447110:0:6613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917200 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229088.447113:0:6613:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447119:0:6613:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229088.447125:0:6613:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229088.447135:0:6613:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1782229088.447137:0:6613:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1782229088.447139:0:6613:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1782229088.447144:0:6613:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98fe58071800 00010000:00010000:1.0:1782229088.447146:0:6613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447153:0:6613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e63977 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e6397e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229088.447166:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229088.447168:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229088.447170:0:6613:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229088.447862:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1782229088.450954:0:13147:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fe74e58480 - data ffff98fe81237ca8/ffff98fd41ab1c00 00000020:01000000:2.0:1782229088.451071:0:13147:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff98fe68e934e0 - data ffff98fe77ea15e8/ffff98fe77ca8800 00100000:10000000:2.0:1782229088.460262:0:13147:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1782229088.479701:0:13147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63636 00000020:00000080:2.0:1782229088.479712:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe819ed000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1782229088.479730:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819ed000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:2.0:1782229088.479742:0:13147:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fe7fe6d000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1782229088.479746:0:13147:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe7fe6d000 2 00000020:01000004:2.0:1782229088.479749:0:13147:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98fe7fe6d000 from lustre-OST0001 00000020:00000080:2.0:1782229088.479833:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782229088.479843:0:13147:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1782229088.479847:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe819ee800/lustre-OST0001_UUID 00000020:00000080:2.0:1782229088.479849:0:13147:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe819ee800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1782229088.479856:0:13147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1782229088.479969:0:13147:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import c9dd69a8-6985-42fa-86d8-1fd8a4966144->MGS 00010000:00010000:2.0:1782229088.479986:0:13147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e6354f expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782229088.480014:0:13147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e6354f expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782229088.480020:0:13147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1782229088.480022:0:13147:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1782229088.480026:0:13147:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1782229088.480039:0:13147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98fe58071800 00010000:00010000:2.0:1782229088.480044:0:13147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051200/0x8e1c8a3488e63548 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e6354f expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229088.480060:0:13147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8e1c8a3488e6378d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782229088.480066:0:13147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8e1c8a3488e6378d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782229088.480071:0:13147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782229088.480073:0:13147:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1782229088.480075:0:13147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1782229088.480083:0:13147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98fe58071800 00010000:00010000:2.0:1782229088.480086:0:13147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe82051000/0x8e1c8a3488e63786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8e1c8a3488e6378d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782229088.480103:0:13147:0:(import.c:65:import_set_state_nolock()) ffff98fe58071800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1782229088.480107:0:13147:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1782229088.480110:0:13147:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1782229088.480111:0:13147:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1782229088.480115:0:13147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1782229088.480128:0:13147:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff98fd42a35c00 x1868802329496576/t0(0) o250->MGC192.168.204.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782229090 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1782229088.480154:0:13147:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1782229088.480157:0:13147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1782229088.480186:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9dd69a8-6985-42fa-86d8-1fd8a4966144:3307:1868802329496576:0@lo:250:kworker.0 10000000:01000000:2.0:1782229088.480211:0:13147:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1782229088.480218:0:13147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63429 00000020:00000080:2.0:1782229088.480223:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe582e3000/c9dd69a8-6985-42fa-86d8-1fd8a4966144 00000020:01000000:2.0:1782229088.480231:0:13147:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.122@tcp (flags='') 00000020:00000080:2.0:1782229088.480239:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe582e3000/c9dd69a8-6985-42fa-86d8-1fd8a4966144 for MGC192.168.204.122@tcp 00000020:00000080:2.0:1782229088.480249:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782229088.480254:0:13147:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.122@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782229088.480257:0:13147:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff98fe68ea3380) has no exports 10000000:01000000:2.0:1782229088.480272:0:5794:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1782229088.480312:0:13147:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.122@tcp: client import never connected 00000100:00080000:2.0:1782229088.480315:0:13147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1782229088.480317:0:13147:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1782229088.480319:0:13147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1782229088.480320:0:13147:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1782229088.480339:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe58071800 for MGC192.168.204.122@tcp 00000020:00000080:2.0:1782229088.480368:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782229088.480372:0:13147:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.122@tcp (uuid c9dd69a8-6985-42fa-86d8-1fd8a4966144) 00000020:00000080:2.0:1782229088.480374:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe58070000/c9dd69a8-6985-42fa-86d8-1fd8a4966144 00000020:00000080:2.0:1782229088.480376:0:13147:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe58070000/c9dd69a8-6985-42fa-86d8-1fd8a4966144 for MGC192.168.204.122@tcp 00000020:01000000:2.0:1782229088.480380:0:13147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.122@tcp (c9dd69a8-6985-42fa-86d8-1fd8a4966144) 00000020:01000000:2.0:1782229088.480651:0:13147:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1782229088.480655:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782229088.480659:0:13147:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782229088.480663:0:13147:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98fe77bcb000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782229088.480668:0:13147:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff98fe77bc4d40) has exports, disconnecting them 00000020:00080000:2.0:1782229088.480672:0:13147:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98fe77bcb000), last request at 1782228870 00000020:00000080:2.0:1782229088.480682:0:13147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63660 00000020:00080000:2.0:1782229088.480693:0:13147:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff98fe77bcb000): rc 0 00000020:00000080:2.0:1782229088.480696:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe77bcb000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1782229088.480721:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77bcb000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1782229088.486520:0:13147:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782229088.486531:0:13147:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782229088.486535:0:13147:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782229088.486544:0:13147:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782229088.486644:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1782229088.486913:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff98fe7fe6a800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1782229088.486928:0:6613:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1782229088.487068:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1782229088.487928:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98fe502e1200:5780] 1 exiting: rc = 0 00000100:00100000:2.0:1782229088.492330:0:5779:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98fe45224800:5779] 0 exiting: rc = 1 00000100:00100000:3.0:1782229088.492528:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.492808:0:11530:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98fe5098e600:11530] 3 exiting: rc = 0 00000100:00100000:2.0:1782229088.492958:0:5781:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98fe50df2600:5781] 0 exiting: rc = 1 00000100:00100000:1.0:1782229088.493032:0:5783:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98fe50d53c00:5783] 2 exiting: rc = 0 00000100:00100000:3.0:1782229088.493310:0:5782:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98fe5080cc00:5782] 1 exiting: rc = 0 00000100:00100000:3.0:1782229088.493359:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493382:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493389:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493395:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493401:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493420:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493427:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493459:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493466:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493472:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493477:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493483:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493490:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493496:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493502:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493509:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493515:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493522:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493527:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493531:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493536:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493541:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493546:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493551:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493567:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493573:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493579:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493585:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493591:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493597:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493602:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493607:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493613:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493619:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493625:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493630:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493643:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493649:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493654:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493659:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493664:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493668:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493674:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493679:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493684:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493689:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493694:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493700:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493705:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493710:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493715:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493720:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493725:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493730:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493735:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493740:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493747:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493752:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493973:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493982:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493987:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493993:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.493998:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.494003:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782229088.499060:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782229088.499077:0:13147:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1782229088.499083:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe7fe2f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1782229088.499089:0:13147:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7fe2f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1782229088.499095:0:13147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1782229088.499135:0:13147:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe7fe6d000 1 00000020:00000080:3.0:1782229088.499151:0:13147:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8e1c8a3488e63605 00000020:00000080:3.0:1782229088.499158:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe77b06800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1782229088.499178:0:13147:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1782229088.499183:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782229088.499187:0:13147:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782229088.499190:0:13147:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff98fe66024d40) has no exports 00000020:00000080:1.0:1782229088.499787:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77b06800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1782229088.602335:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782229088.602352:0:13147:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1782229088.602358:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe77c4d800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1782229088.602364:0:13147:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe77c4d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1782229088.602376:0:13147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1782229088.602601:0:13147:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff98fe81983800 00000020:01000000:0.0:1782229088.602626:0:13147:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1782229088.602643:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782229088.602648:0:13147:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782229088.602652:0:13147:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff98fe68ea0000) has no exports 00000020:00000080:0.0:1782229088.602676:0:13147:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782229088.602682:0:13147:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1782229088.602693:0:13147:0:(genops.c:906:class_export_put()) final put ffff98fe7b638800/OSS_uuid 00000020:00000080:0.0:1782229088.602696:0:13147:0:(genops.c:865:class_export_destroy()) destroying export ffff98fe7b638800/OSS_uuid for OSS 00000020:01000000:0.0:1782229088.602700:0:13147:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1782229088.602824:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98fe742e7e00:6599] 1 exiting: rc = 0 00000100:00100000:0.0:1782229088.603081:0:12346:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff98fd431a8c00:12346] 4 exiting: rc = 0 00000100:00100000:1.0:1782229088.603256:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98fe5085e600:6600] 2 exiting: rc = 0 00000100:00080000:3.0:1782229088.604713:0:5793:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1782229088.607194:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98fe6c51be00:6598] 0 exiting: rc = 1 00000100:00100000:3.0:1782229088.608025:0:8488:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98fe77c0fa00:8488] 3 exiting: rc = 0 00000100:00100000:0.0:1782229088.610191:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610202:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610277:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610285:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610289:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610294:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610299:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610308:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610314:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610319:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610325:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610330:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610335:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610340:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610345:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610350:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610355:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610360:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610366:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610371:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610376:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610381:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610388:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610393:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610411:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610607:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610616:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610621:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610626:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610631:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610656:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610661:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610666:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610671:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610675:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610681:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610686:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610691:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610696:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610703:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610710:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610715:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610719:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610724:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610729:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610734:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610740:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610744:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610750:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610755:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610894:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610901:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610907:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610912:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610917:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610922:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610927:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610932:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610938:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610943:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.610949:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.611111:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.611118:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.611123:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782229088.612599:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98fe50946c00:6601] 0 exiting: rc = 1 00000100:00100000:2.0:1782229088.612743:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98fe5085f800:6602] 1 exiting: rc = 0 00000100:00100000:0.0:1782229088.613144:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613171:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613177:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613182:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613188:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613194:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613200:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613262:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613270:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613276:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613282:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613288:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613294:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613299:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613305:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613311:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613316:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613322:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613327:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613333:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613338:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613343:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613348:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613354:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613359:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613364:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613370:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613375:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613381:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613387:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613393:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613646:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613653:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613658:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613663:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613668:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613680:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613686:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613691:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613696:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613701:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613705:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613710:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613715:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613720:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613726:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613731:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613741:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613748:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613754:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613760:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613766:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613772:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613777:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613782:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613788:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613793:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613798:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613803:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613809:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613816:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613822:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613827:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.613833:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.616385:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98fe68f6ba00:6605] 2 exiting: rc = 0 00000100:00100000:2.0:1782229088.616397:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98fe81edc200:6604] 1 exiting: rc = 0 00000100:00100000:2.0:1782229088.616609:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98fe438e9200:6603] 0 exiting: rc = 1 00000100:00100000:0.0:1782229088.617547:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617574:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617579:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617586:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617591:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617597:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617613:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617619:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617625:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617630:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617636:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617652:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617659:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617665:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617670:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617677:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617683:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617689:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617695:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617701:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617706:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617712:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617718:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617723:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617728:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617734:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617740:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617745:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617751:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617756:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617762:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617768:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617773:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617778:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617784:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617803:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617809:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617816:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617821:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617826:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617831:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617843:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617849:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617855:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617861:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617867:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617872:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617878:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617884:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617888:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617894:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617899:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617914:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617921:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617926:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617939:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.617948:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.618147:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.618155:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.618161:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.618167:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.618173:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.618178:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.618183:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782229088.626903:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98fe68f6a000:6606] 0 exiting: rc = 1 00000100:00100000:0.0:1782229088.627108:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98fe68f6a400:6607] 1 exiting: rc = 0 00000100:00100000:0.0:1782229088.627159:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627165:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627170:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627176:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627182:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627188:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627194:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627200:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627205:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627210:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627216:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627231:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627237:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627242:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627248:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627253:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627258:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627264:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627269:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627274:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627279:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627285:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627290:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627295:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627301:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627306:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627311:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627316:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627321:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627326:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627331:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627336:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627340:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627345:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627349:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627395:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627400:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627405:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627410:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627415:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627421:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627728:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627735:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627741:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627746:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627751:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627771:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627777:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627782:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627788:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627793:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627799:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627804:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627809:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627815:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627820:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627825:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627831:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627836:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627841:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627846:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627851:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627856:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.627861:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782229088.628783:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98fe68ff4400:6608] 0 exiting: rc = 1 00000100:00100000:1.0:1782229088.629067:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98fe51792400:6609] 1 exiting: rc = 0 00000100:00100000:0.0:1782229088.629152:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629166:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629172:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629178:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629184:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629190:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629195:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629200:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629206:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629211:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629218:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629224:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629230:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629247:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629253:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629259:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629264:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629277:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629282:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629289:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629295:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629300:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629307:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629313:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629318:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629335:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629342:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629347:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629353:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629359:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629364:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629369:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629375:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629380:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629385:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629391:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629396:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629413:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629418:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629423:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629488:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629494:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629500:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629507:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629513:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629520:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629525:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629532:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629537:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629571:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629579:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629584:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629597:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629604:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629610:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629615:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629620:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629693:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629703:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629709:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629715:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629721:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629726:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782229088.629741:0:13147:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1782229088.649747:0:13147:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1782229107.159034:0:13762:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782229116.330999:0:14175:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782229116.331004:0:14175:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1782229116.331301:0:14175:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98fd42ec2800 00000020:01000004:2.0:1782229116.331317:0:14175:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1782229116.331325:0:14175:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782229116.331339:0:14175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98fe7fffb380) 00000020:00000080:2.0:1782229116.331352:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782229116.375199:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782229116.387032:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1782229116.389200:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782229116.390094:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 445: rc = 0 00100000:10000000:3.0:1782229116.392077:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 445: rc = 0 00100000:10000000:3.0:1782229116.392246:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 445: rc = 0 00100000:10000000:3.0:1782229116.392737:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 445: rc = 0 00100000:10000000:3.0:1782229116.392840:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 445: rc = 0 00100000:10000000:3.0:1782229116.394049:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 445: rc = 0 00100000:10000000:3.0:1782229116.395202:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 447: rc = 0 00100000:10000000:0.0:1782229116.397317:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:0.0:1782229116.397420:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:0.0:1782229116.398545:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:0.0:1782229116.398959:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1782229116.403792:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 648: rc = 0 00100000:10000000:1.0:1782229116.404062:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 648: rc = 0 00100000:10000000:1.0:1782229116.404612:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1782229116.404989:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1782229116.405462:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:1.0:1782229116.406427:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1782229116.406814:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1782229116.407528:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:1.0:1782229116.407844:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1782229116.408368:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 648: rc = 0 00100000:10000000:1.0:1782229116.408990:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 165: rc = 0 00100000:10000000:1.0:1782229116.409669:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 165: rc = 0 00100000:10000000:1.0:1782229116.410115:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 165: rc = 0 00100000:10000000:1.0:1782229116.410515:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 165: rc = 0 00100000:10000000:1.0:1782229116.410833:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 165: rc = 0 00100000:10000000:1.0:1782229116.411226:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 165: rc = 0 00100000:10000000:1.0:1782229116.411703:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 165: rc = 0 00100000:10000000:1.0:1782229116.412629:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 165: rc = 0 00100000:10000000:1.0:1782229116.413049:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 165: rc = 0 00100000:10000000:1.0:1782229116.413474:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 165: rc = 0 00100000:10000000:1.0:1782229116.413799:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 165: rc = 0 00100000:10000000:1.0:1782229116.414207:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 165: rc = 0 00100000:10000000:1.0:1782229116.414609:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 165: rc = 0 00100000:10000000:1.0:1782229116.414864:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 165: rc = 0 00100000:10000000:1.0:1782229116.415507:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 165: rc = 0 00100000:10000000:1.0:1782229116.415825:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 165: rc = 0 00100000:10000000:1.0:1782229116.416217:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 165: rc = 0 00100000:10000000:1.0:1782229116.416697:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 165: rc = 0 00100000:10000000:1.0:1782229116.417082:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 165: rc = 0 00100000:10000000:1.0:1782229116.417495:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 165: rc = 0 00100000:10000000:1.0:1782229116.417800:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 165: rc = 0 00100000:10000000:1.0:1782229116.418219:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 165: rc = 0 00100000:10000000:1.0:1782229116.419078:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 165: rc = 0 00100000:10000000:1.0:1782229116.419651:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 165: rc = 0 00100000:10000000:1.0:1782229116.420041:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 165: rc = 0 00100000:10000000:1.0:1782229116.420415:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 165: rc = 0 00100000:10000000:1.0:1782229116.420765:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 165: rc = 0 00100000:10000000:1.0:1782229116.421168:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 165: rc = 0 00100000:10000000:1.0:1782229116.421627:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 165: rc = 0 00100000:10000000:1.0:1782229116.422026:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 165: rc = 0 00100000:10000000:1.0:1782229116.422355:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 165: rc = 0 00100000:10000000:1.0:1782229116.422735:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 165: rc = 0 00100000:10000000:1.0:1782229116.423218:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 154: rc = 0 00100000:10000000:1.0:1782229116.423750:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1782229116.424169:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:1.0:1782229116.424412:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1782229116.424515:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:1.0:1782229116.424773:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1782229116.424844:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:1.0:1782229116.425385:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1782229116.425479:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:1.0:1782229116.425733:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1782229116.425798:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:1.0:1782229116.426128:0:14175:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1782229116.426198:0:14175:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00000020:00000080:1.0:1782229116.426632:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1782229116.426640:0:14175:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782229116.426650:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e6472a 00000020:01000004:1.0:1782229116.426658:0:14175:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1782229116.426668:0:14175:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1782229116.426673:0:14175:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fd42ec2800 from MGS 00000020:01000004:1.0:1782229116.426676:0:14175:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1782229116.426686:0:14175:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98fe77bc19c0) 00000020:00000080:1.0:1782229116.426696:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1782229116.426746:0:14175:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fd42ec2800 from MGS, refs=2 00080000:01000000:1.0:1782229116.426751:0:14175:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782229116.426755:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e64738 00000100:00100000:1.0:1782229116.426846:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1782229116.427096:0:14175:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1782229116.427103:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782229116.427763:0:14175:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782229116.427770:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782229116.428746:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782229116.429026:0:14175:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782229116.429033:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782229116.429633:0:14175:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782229116.429639:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782229116.429989:0:14175:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782229116.429995:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782229116.430753:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229116.430756:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229116.430758:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229116.431096:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229116.431098:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229116.431100:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229116.431707:0:14175:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782229116.432991:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1782229116.443408:0:14175:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782229116.443425:0:14175:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782229116.443451:0:14175:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782229116.445720:0:14184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782229116.446500:0:14175:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782229116.446679:0:14175:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782229116.448134:0:14175:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782229116.448809:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782229116.449452:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782229116.449460:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782229116.450648:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782229116.450657:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1782229116.451171:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782229116.451177:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1782229116.452870:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782229116.452890:0:14175:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.122@tcp' 00000020:01000004:2.0:1782229116.452892:0:14175:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782229116.453045:0:14175:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.122@tcp (typ=mgc) 00000020:00000080:2.0:1782229116.453057:0:14175:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.122@tcp (ffff98fe7fff8000) 00000020:00000080:2.0:1782229116.453071:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782229116.453147:0:14175:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe74511800@MGC192.168.204.122@tcp: add connection 192.168.204.122@tcp at head 00010000:00010000:2.0:1782229116.453288:0:14175:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.122@tcp-0 is initialized 00000040:01000000:2.0:1782229116.453293:0:14175:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 1 is initialized 10000000:01000000:2.0:1782229116.454721:0:14190:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1782229116.454756:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.122@tcp (uuid 09a36ffd-1c8e-4eae-8f1c-059ef97c8e41) 00000020:00000080:2.0:1782229116.454774:0:14175:0:(genops.c:1406:class_connect()) connect: client 09a36ffd-1c8e-4eae-8f1c-059ef97c8e41, cookie 0x8e1c8a3488e64746 00000100:00080000:2.0:1782229116.454785:0:14175:0:(import.c:512:import_select_connection()) MGC192.168.204.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782229116.454791:0:14175:0:(import.c:626:import_select_connection()) MGC192.168.204.122@tcp: import ffff98fe74511800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:2.0:1782229116.454820:0:14175:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe6ee3b800 x1868802329496960/t0(0) o250->MGC192.168.204.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782229116.454841:0:14175:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 09a36ffd-1c8e-4eae-8f1c-059ef97c8e41->MGS 00000020:01000004:2.0:1782229116.454976:0:14175:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1782229116.454981:0:14175:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1782229116.454992:0:14175:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98fe7fffcd40) 00000020:00000080:2.0:1782229116.455002:0:14175:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1782229116.456144:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3307:1868802329496960:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1782229116.456325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229116.456661:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329496960 00000100:00100000:3.0:1782229116.456670:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329496960 00000100:00100000:3.0:1782229116.456701:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782229116.456717:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1868802329496960:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1782229116.456741:0:14186:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 09a36ffd-1c8e-4eae-8f1c-059ef97c8e41@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:3.0:1782229116.456763:0:14186:0:(genops.c:1406:class_connect()) connect: client 09a36ffd-1c8e-4eae-8f1c-059ef97c8e41, cookie 0x8e1c8a3488e64754 00000100:00080000:3.0:1782229116.457675:0:14186:0:(import.c:65:import_set_state_nolock()) ffff98fe452e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782229116.457752:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+5:3307:x1868802329496960:12345-0@lo:250:mount.lustre.0 Request processed in 1034us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229116.457761:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1782229116.457833:0:14189:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1782229116.458923:0:3307:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1782229116.458935:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1782229116.458943:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1782229116.458948:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1782229116.458953:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe74511800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1782229116.458955:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1782229116.458965:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1782229116.458971:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3307:1868802329496960:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1782229116.471293:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782229116.471507:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1782229116.471514:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782229116.477640:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782229116.477651:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782229116.481349:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782229116.481360:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782229116.485259:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782229116.485463:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782229116.485470:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1782229116.486324:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1782229116.486332:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782229116.527754:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782229116.528212:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782229116.528228:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1782229116.529736:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1782229116.529745:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782229116.530730:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782229116.531004:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782229116.531021:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782229116.531610:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782229116.531682:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1782229116.532339:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782229116.532670:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782229116.532674:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782229116.533238:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782229116.533244:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782229116.538247:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782229116.538683:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782229116.538689:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782229116.539405:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782229116.539412:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1782229116.569350:0:14175:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782229116.569757:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782229116.569764:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1782229116.571733:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782229116.571744:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782229116.572803:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782229116.572811:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782229116.574121:0:14175:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782229116.574147:0:14175:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1782229116.574153:0:14175:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782229116.574405:0:14175:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782229116.574691:0:14175:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.122@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1782229116.574696:0:14175:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782229116.574698:0:14175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782229116.574700:0:14175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782229116.574705:0:14175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782229116.574706:0:14175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782229116.574708:0:14175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782229116.574709:0:14175:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782229116.574710:0:14175:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782229116.574712:0:14175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782229116.574713:0:14175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782229116.574716:0:14175:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1782229116.574718:0:14175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782229116.574719:0:14175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782229116.574720:0:14175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782229116.574721:0:14175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782229116.574722:0:14175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782229116.574723:0:14175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782229116.574724:0:14175:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782229116.574725:0:14175:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782229116.574726:0:14175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782229116.574727:0:14175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782229116.574751:0:14175:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782229116.574770:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782229116.574834:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229116.575055:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.575135:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497088 00000100:00100000:2.0:1782229116.575144:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497088 00000100:00100000:2.0:1782229116.575230:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782229116.575240:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+5:14175:x1868802329497088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782229116.575296:0:14188:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782229116.575299:0:14188:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782229116.575303:0:14188:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1782229116.575802:0:14209:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782229116.576309:0:14188:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1782229116.578001:0:14210:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1782229116.578018:0:14210:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1782229116.578021:0:14210:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1782229116.578054:0:14210:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1782229116.578354:0:14188:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782229116.578364:0:14188:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782229116.592145:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+5:14175:x1868802329497088:12345-0@lo:253:mount.lustre.0 Request processed in 16898us (17301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.592159:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782229116.592342:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782229116.592355:0:14175:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782229116.592358:0:14175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782229116.592359:0:14175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782229116.592361:0:14175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782229116.592362:0:14175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782229116.592363:0:14175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782229116.592365:0:14175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782229116.592366:0:14175:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782229116.592367:0:14175:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782229116.592369:0:14175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782229116.592371:0:14175:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782229116.592391:0:14175:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fd42ec2800 from lustre-MDT0000 10000000:01000000:3.0:1782229116.592621:0:14175:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782229116.592624:0:14175:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782229116.592629:0:14175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98fe7fff8000 10000000:01000000:3.0:1782229116.592633:0:14175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782229116.592640:0:14175:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff98fe7fff8000 from 1 10000000:01000000:3.0:1782229116.592644:0:14175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782229116.592680:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229116.592690:0:14175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229116.592699:0:14175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229116.592717:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782229116.592751:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229116.592822:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.592980:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497216 00000100:00100000:2.0:1782229116.592986:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497216 00000100:00100000:2.0:1782229116.593086:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782229116.593094:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+5:14175:x1868802329497216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782229116.593107:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229116.593122:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcc200/0x8e1c8a3488e64762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6475b expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.593144:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcc200/0x8e1c8a3488e64762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6475b expref: 6 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.593155:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcc200/0x8e1c8a3488e64762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6475b expref: 6 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.593174:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcc200, rc 0) 00000100:00100000:2.0:1782229116.593221:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+6:14175:x1868802329497216:12345-0@lo:101:mount.lustre.0 Request processed in 128us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.593227:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782229116.593291:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782229116.593303:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.593312:0:14175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229116.593355:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229116.593380:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.593990:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4600 going to sleep for 11 seconds 00000100:00100000:3.0:1782229116.594025:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497344 00000100:00100000:3.0:1782229116.594030:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497344 00000100:00100000:3.0:1782229116.594054:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782229116.594060:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+6:14175:x1868802329497344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782229116.594470:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+6:14175:x1868802329497344:12345-0@lo:501:mount.lustre.0 Request processed in 408us (1086us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782229116.594477:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782229116.594684:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497344:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782229116.594714:0:14175:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782229116.594769:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.594779:0:14175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229116.594800:0:14175:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fd42ec2800 10000000:01000000:1.0:1782229116.594805:0:14175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782229116.594809:0:14175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98fd42ec2800 10000000:01000000:1.0:1782229116.594812:0:14175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782229116.594815:0:14175:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff98fd42ec2800 from 1 10000000:01000000:1.0:1782229116.594818:0:14175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782229116.594842:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74421400/0x8e1c8a3488e64769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.594862:0:14175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe74421400/0x8e1c8a3488e64769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.594871:0:14175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe74421400/0x8e1c8a3488e64769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.594888:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782229116.595051:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.595082:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41ca1600 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.595135:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497472 00000100:00100000:2.0:1782229116.595141:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497472 00000100:00100000:2.0:1782229116.595165:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782229116.595171:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+6:14175:x1868802329497472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782229116.595179:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229116.595192:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e64770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64769 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.595220:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e64770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64769 expref: 7 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.595231:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcca00/0x8e1c8a3488e64770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64769 expref: 7 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.595239:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcca00, rc 0) 00000100:00100000:2.0:1782229116.595288:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+7:14175:x1868802329497472:12345-0@lo:101:mount.lustre.0 Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.595294:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782229116.595465:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229116.595477:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe74421400/0x8e1c8a3488e64769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64770 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.595486:0:14175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe74421400/0x8e1c8a3488e64769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64770 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229116.595497:0:14175:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782229116.596107:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74421400/0x8e1c8a3488e64769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64770 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.596129:0:14175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe74421400/0x8e1c8a3488e64769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64770 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229116.596136:0:14175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782229116.596140:0:14175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782229116.596146:0:14175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98fd42ec2800 10000000:01000000:1.0:1782229116.596149:0:14175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782229116.596152:0:14175:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782229116.596155:0:14175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782229116.596176:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420c00/0x8e1c8a3488e64777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.596184:0:14175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe74420c00/0x8e1c8a3488e64777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.596191:0:14175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe74420c00/0x8e1c8a3488e64777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.596531:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782229116.596669:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.596702:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41ca1600 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.596756:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497600 00000100:00100000:2.0:1782229116.596762:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497600 00000100:00100000:2.0:1782229116.596802:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782229116.596811:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+7:14175:x1868802329497600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782229116.596820:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229116.596840:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6477e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64777 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.597029:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6477e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64777 expref: 8 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.597040:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcd600/0x8e1c8a3488e6477e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64777 expref: 8 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.597048:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd600, rc 0) 00000100:00100000:2.0:1782229116.597088:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+8:14175:x1868802329497600:12345-0@lo:101:mount.lustre.0 Request processed in 279us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.597095:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782229116.597174:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229116.597187:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe74420c00/0x8e1c8a3488e64777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6477e expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.597194:0:14175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe74420c00/0x8e1c8a3488e64777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6477e expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.597379:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782229116.597407:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.597528:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41ca1600 going to sleep for 11 seconds 00000100:00100000:3.0:1782229116.597678:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497728 00000100:00100000:3.0:1782229116.597684:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497728 00000100:00100000:3.0:1782229116.597751:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782229116.597760:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+8:14175:x1868802329497728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782229116.598668:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14175:x1868802329497728:12345-0@lo:501:mount.lustre.0 Request processed in 908us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229116.598677:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782229116.598739:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782229116.598778:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782229116.598819:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.599015:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41ca1600 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.599045:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497856 00000100:00100000:2.0:1782229116.599050:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497856 00000100:00100000:2.0:1782229116.599106:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782229116.599113:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14175:x1868802329497856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782229116.599639:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14175:x1868802329497856:12345-0@lo:503:mount.lustre.0 Request processed in 524us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.599646:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782229116.599731:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329497856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782229116.600609:0:14211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14211:1868802329497984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782229116.600662:0:14211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229116.600724:0:14211:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe47d54cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782229116.600762:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329497984 00000100:00100000:3.0:1782229116.600769:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329497984 00000100:00100000:3.0:1782229116.600840:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782229116.600859:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14211:x1868802329497984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782229116.601377:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14211:x1868802329497984:12345-0@lo:502:llog_process_th.0 Request processed in 529us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229116.601385:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782229116.601482:0:14211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14211:1868802329497984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782229116.601510:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229116.601522:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.601524:0:14211:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782229116.601530:0:14211:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782229116.601532:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782229116.601557:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98fe66024d40) 00000020:00000080:0.0:1782229116.601573:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782229116.601579:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782229116.601645:0:14211:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782229116.601652:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e6478c 00000020:00000080:0.0:1782229116.601866:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782229116.601871:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229116.601874:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.601884:0:14211:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782229116.601888:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229116.602087:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.602090:0:14211:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782229116.602095:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782229116.602102:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98fe66020000) 00000020:00000080:0.0:1782229116.602112:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782229116.602115:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782229116.602118:0:14211:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782229116.602120:0:14211:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782229116.602126:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782229116.602171:0:14211:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fd42ec2800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782229116.602183:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98fe660219c0) 00000020:00000080:0.0:1782229116.602191:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782229116.602255:0:14211:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782229116.602263:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e647a1 00000020:00000080:0.0:1782229116.602348:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782229116.602354:0:14211:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782229116.602358:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8e1c8a3488e647a8 00080000:01000000:0.0:1782229116.602363:0:14211:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782229116.602366:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e647af 00010000:00010000:3.0:1782229116.682807:0:14211:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1782229116.683242:0:14211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1782229116.683401:0:14211:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782229116.685094:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98fe74e399c0) 00000020:00000080:3.0:1782229116.685120:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782229116.685188:0:14211:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782229116.685194:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e647bd 00000020:00000080:1.0:1782229116.691719:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1782229116.696097:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8e1c8a3488e647c4 00000020:00000080:1.0:1782229116.696420:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782229116.696468:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229116.696474:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.696476:0:14211:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782229116.696479:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782229116.696482:0:14211:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1782229116.696483:0:14211:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782229116.696485:0:14211:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782229116.696486:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782229116.696488:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.696489:0:14211:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782229116.696491:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782229116.696495:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.696496:0:14211:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782229116.696501:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782229116.696532:0:14211:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782229116.696545:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229116.696547:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.696549:0:14211:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1782229116.696559:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782229116.696562:0:14211:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782229116.696565:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.696566:0:14211:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782229116.696569:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782229116.696574:0:14211:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.122@tcp to nid 0x20000c0a8cc7a (192.168.204.122@tcp) 00000020:01000000:1.0:1782229116.696598:0:14211:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782229116.696600:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782229116.696614:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98fe77bc3380) 00000020:00000080:1.0:1782229116.696627:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1782229116.696631:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782229116.696679:0:14211:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782229116.696684:0:14211:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782229116.696691:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e647d2 00010000:00080000:1.0:1782229116.696723:0:14211:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe50810000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.122@tcp at head 00010000:00010000:1.0:1782229116.697026:0:14211:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1782229116.697330:0:14211:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782229116.697372:0:14211:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782229116.699188:0:14211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782229116.699258:0:14211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1782229116.699343:0:14211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1782229116.705138:0:14215:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782229116.705146:0:14215:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782229116.707984:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782229116.707999:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782229116.708039:0:14211:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782229116.708055:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e647d9 00000100:00080000:1.0:1782229116.708065:0:14211:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782229116.708071:0:14211:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98fe50810000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:1.0:1782229116.708103:0:14211:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe446ad180 x1868802329498112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782229116.708121:0:14211:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782229116.708187:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229116.708191:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.708193:0:14211:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782229116.708196:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782229116.708199:0:14211:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1782229116.708200:0:14211:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782229116.708202:0:14211:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782229116.708203:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782229116.708205:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.708206:0:14211:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782229116.708209:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782229116.708213:0:14211:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782229116.708216:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.708218:0:14211:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782229116.708220:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782229116.708224:0:14211:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.122@tcp to nid 0x20000c0a8cc7a (192.168.204.122@tcp) 00000020:01000000:1.0:1782229116.708245:0:14211:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782229116.708247:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782229116.708257:0:14211:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98fe77bc4d40) 00000020:00000080:1.0:1782229116.708267:0:14211:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1782229116.708271:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782229116.708317:0:14211:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782229116.708322:0:14211:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782229116.708327:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8e1c8a3488e647e7 00010000:00080000:1.0:1782229116.708365:0:14211:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe77bc9800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.122@tcp at head 00000100:00100000:0.0:1782229116.708492:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329498112:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782229116.708546:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868802329498112 offset 0 length 520: 4 00010000:00010000:1.0:1782229116.708868:0:14211:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1782229116.709254:0:14211:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782229116.709275:0:14211:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782229116.710069:0:14211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782229116.710129:0:14211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1782229116.710207:0:14211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1782229116.712871:0:14217:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782229116.712879:0:14217:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782229116.713625:0:14211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782229116.713636:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782229116.713674:0:14211:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782229116.713693:0:14211:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e647ee 00000100:00080000:1.0:1782229116.713704:0:14211:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782229116.713709:0:14211:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98fe77bc9800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:1.0:1782229116.713743:0:14211:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe446ac380 x1868802329498240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782229116.713771:0:14211:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782229116.713830:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229116.713834:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.713836:0:14211:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782229116.713839:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782229116.713843:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.713844:0:14211:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782229116.713847:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782229116.713849:0:14211:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782229116.713851:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229116.713854:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.713855:0:14211:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782229116.713858:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782229116.713860:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.713861:0:14211:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782229116.713865:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782229116.714249:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329498240:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782229116.714301:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868802329498240 offset 0 length 520: 4 00000100:00100000:1.0:1782229116.714360:0:14211:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14211:1868802329498368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782229116.714417:0:14211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.714548:0:14211:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43aedc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.716678:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329498368 00000100:00100000:2.0:1782229116.716690:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329498368 00000100:00100000:2.0:1782229116.716780:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782229116.716792:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14211:x1868802329498368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782229116.718212:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14211:x1868802329498368:12345-0@lo:502:llog_process_th.0 Request processed in 1418us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.718233:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782229116.718327:0:14211:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14211:1868802329498368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782229116.718361:0:14211:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229116.718368:0:14211:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229116.718371:0:14211:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782229116.718376:0:14211:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1782229116.719024:0:14175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1782229116.719046:0:14175:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782229116.719062:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420c00/0x8e1c8a3488e64777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6477e expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.719073:0:14175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe74420c00/0x8e1c8a3488e64777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6477e expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782229116.719102:0:14175:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fd42ec2800 from 1 10000000:01000000:0.0:1782229116.719106:0:14175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782229116.719140:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.719147:0:14175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.719155:0:14175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229116.719174:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782229116.719218:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229116.720331:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4180 going to sleep for 11 seconds 00000100:00100000:3.0:1782229116.724533:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329498496 00000100:00100000:3.0:1782229116.724548:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329498496 00000100:00100000:3.0:1782229116.724615:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782229116.724625:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+9:14175:x1868802329498496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782229116.724642:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229116.724663:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e647f5 expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229116.724703:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 10 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229116.724714:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 10 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229116.724724:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917600, rc 0) 00000100:00100000:3.0:1782229116.724797:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+10:14175:x1868802329498496:12345-0@lo:101:mount.lustre.0 Request processed in 173us (5579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229116.724804:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782229116.726191:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782229116.726213:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.726223:0:14175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229116.727114:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498624:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1782229116.727184:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229116.727216:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4180 going to sleep for 11 seconds 00000100:00100000:3.0:1782229116.728189:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329498624 00000100:00100000:3.0:1782229116.728198:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329498624 00000100:00100000:3.0:1782229116.728240:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782229116.728248:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+10:14175:x1868802329498624:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1782229116.728271:0:14188:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782229116.728278:0:14188:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782229116.728360:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+10:14175:x1868802329498624:12345-0@lo:256:mount.lustre.0 Request processed in 112us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229116.728367:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782229116.728651:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498624:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782229116.729320:0:14175:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782229116.729374:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.729732:0:14175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782229116.729741:0:14175:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fd42ec2800 from 1 10000000:01000000:0.0:1782229116.729743:0:14175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782229116.729775:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.729783:0:14175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.729792:0:14175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229116.729812:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782229116.729863:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229116.730111:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329498752 00000100:00100000:2.0:1782229116.730117:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329498752 00000100:00100000:2.0:1782229116.730160:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782229116.730167:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+10:14175:x1868802329498752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782229116.730178:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229116.730192:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64803 expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.730214:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 11 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.730225:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 11 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.730234:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dccc00, rc 0) 00000100:00100000:2.0:1782229116.730279:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14175:x1868802329498752:12345-0@lo:101:mount.lustre.0 Request processed in 112us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.730286:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782229116.730549:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1782229116.730569:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782229116.730583:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.730591:0:14175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229116.730642:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229116.730670:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229116.730696:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4180 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.730754:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329498880 00000100:00100000:2.0:1782229116.730758:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329498880 00000100:00100000:2.0:1782229116.730785:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782229116.730791:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14175:x1868802329498880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229116.731267:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14175:x1868802329498880:12345-0@lo:501:mount.lustre.0 Request processed in 475us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.731274:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782229116.731612:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329498880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229116.731647:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782229116.731686:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229116.731969:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4180 going to sleep for 11 seconds 00000100:00100000:1.0:1782229116.737690:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499008 00000100:00100000:1.0:1782229116.737722:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499008 00000100:00100000:3.0:1782229116.740463:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782229116.740487:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14175:x1868802329499008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782229116.740731:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14175:x1868802329499008:12345-0@lo:503:mount.lustre.0 Request processed in 256us (9044us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229116.740739:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782229116.740980:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782229116.742303:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14219:1868802329499136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782229116.742368:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229116.742471:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4443ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.742524:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499136 00000100:00100000:2.0:1782229116.742604:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499136 00000100:00100000:2.0:1782229116.742693:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782229116.742702:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14219:x1868802329499136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782229116.742997:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14219:x1868802329499136:12345-0@lo:502:llog_process_th.0 Request processed in 295us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.743015:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782229116.743936:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14219:1868802329499136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782229116.743976:0:14219:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229116.743986:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.743988:0:14219:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782229116.743997:0:14219:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fd42ec2800 00000020:00000080:0.0:1782229116.743999:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782229116.744017:0:14219:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229116.744020:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.744021:0:14219:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782229116.744023:0:14219:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229116.744026:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.744027:0:14219:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782229116.744030:0:14219:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fd42ec2800 00000020:00000080:0.0:1782229116.744032:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782229116.744297:0:14219:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229116.744301:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.744303:0:14219:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782229116.744306:0:14219:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229116.744309:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229116.744310:0:14219:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782229116.744323:0:14219:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98fd42ec2800 00000020:00000080:0.0:1782229116.744325:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782229116.750647:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14219:1868802329499264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782229116.750967:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229116.751037:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499264 00000100:00100000:0.0:1782229116.751045:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499264 00000100:00100000:0.0:1782229116.751893:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782229116.751905:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14219:x1868802329499264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782229116.753032:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe503f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1782229116.754879:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14219:x1868802329499264:12345-0@lo:502:llog_process_th.0 Request processed in 2970us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229116.754892:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782229116.767584:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14219:1868802329499264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782229116.769816:0:14219:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782229116.769830:0:14219:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782229116.769838:0:14219:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782229116.769843:0:14219:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1782229116.771221:0:14175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782229116.771251:0:14175:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782229116.771271:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.771283:0:14175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229116.771339:0:14175:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782229116.771342:0:14175:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fd42ec2800 10000000:01000000:1.0:1782229116.771345:0:14175:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fd42ec2800 10000000:01000000:1.0:1782229116.771349:0:14175:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782229116.771355:0:14175:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fd42ec2800 from 1 10000000:01000000:1.0:1782229116.771357:0:14175:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782229116.771389:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420200/0x8e1c8a3488e64811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.771399:0:14175:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe74420200/0x8e1c8a3488e64811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.771409:0:14175:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe74420200/0x8e1c8a3488e64811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.771448:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782229116.771516:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.771563:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe691549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229116.771592:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499392 00000100:00100000:1.0:1782229116.771603:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499392 00000100:00100000:1.0:1782229116.771645:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782229116.771653:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14175:x1868802329499392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229116.771667:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229116.771681:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe74421c00/0x8e1c8a3488e64818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64811 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.772021:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe74421c00/0x8e1c8a3488e64818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64811 expref: 12 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.772033:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe74421c00/0x8e1c8a3488e64818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64811 expref: 12 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.772041:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421c00, rc 0) 00000100:00100000:1.0:1782229116.772096:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14175:x1868802329499392:12345-0@lo:101:mount.lustre.0 Request processed in 442us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229116.772102:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782229116.772143:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229116.772155:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe74420200/0x8e1c8a3488e64811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64818 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.772163:0:14175:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe74420200/0x8e1c8a3488e64811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64818 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.772202:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782229116.772226:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.772240:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe691549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229116.772386:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499520 00000100:00100000:0.0:1782229116.772391:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499520 00000100:00100000:0.0:1782229116.772419:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782229116.772425:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14175:x1868802329499520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229116.780935:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14175:x1868802329499520:12345-0@lo:501:mount.lustre.0 Request processed in 8500us (8697us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229116.780949:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782229116.790404:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782229116.790478:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782229116.790869:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229116.790911:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782229116.791038:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499648 00000100:00100000:1.0:1782229116.791052:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499648 00000100:00100000:1.0:1782229116.794056:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782229116.794073:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14175:x1868802329499648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782229116.794320:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14175:x1868802329499648:12345-0@lo:503:mount.lustre.0 Request processed in 252us (3451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229116.794329:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782229116.794640:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329499648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782229116.798917:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14224:1868802329499776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782229116.798993:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.799051:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe69154300 going to sleep for 11 seconds 00000100:00100000:2.0:1782229116.799183:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499776 00000100:00100000:2.0:1782229116.799190:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499776 00000100:00100000:2.0:1782229116.799253:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782229116.799262:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14224:x1868802329499776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782229116.799513:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14224:x1868802329499776:12345-0@lo:502:llog_process_th.0 Request processed in 252us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229116.799521:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782229116.800181:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14224:1868802329499776:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1782229116.800261:0:14224:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782229116.800274:0:14224:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98fe77bc0000) 00000020:00000080:1.0:1782229116.800291:0:14224:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1782229116.800482:0:14224:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fd42ec2800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782229116.800486:0:14224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fd42ec2800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782229116.800490:0:14224:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fd42ec2800 4 00010000:00080000:1.0:1782229116.800518:0:14224:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe7b63c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.122@tcp at head 00010000:00010000:1.0:1782229116.806388:0:14224:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1782229116.806515:0:14224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782229116.806554:0:14224:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782229116.806566:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8e1c8a3488e64826 00000100:00080000:1.0:1782229116.806577:0:14224:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782229116.806583:0:14224:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98fe7b63c000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:1.0:1782229116.806617:0:14224:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe446adf80 x1868802329499904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782229116.806639:0:14224:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782229116.807223:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329499904:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782229116.807292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.807990:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329499904 00000100:00100000:1.0:1782229116.808014:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329499904 00000100:00100000:1.0:1782229116.808060:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782229116.808281:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1868802329499904:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782229116.810174:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1868802329499904:12345-0@lo:38:llog_process_th.0 Request processed in 1887us (2875us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782229116.810186:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782229116.810333:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14224:1868802329500032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782229116.810399:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229116.810427:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe69154300 going to sleep for 11 seconds 00000100:00100000:1.0:1782229116.810459:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500032 00000100:00100000:1.0:1782229116.810464:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500032 00000100:00100000:1.0:1782229116.810505:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782229116.810513:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14224:x1868802329500032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782229116.810775:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14224:x1868802329500032:12345-0@lo:502:llog_process_th.0 Request processed in 262us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229116.810783:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782229116.810834:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14224:1868802329500032:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782229116.810857:0:14224:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782229116.811722:0:14175:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782229116.811745:0:14175:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782229116.811761:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420200/0x8e1c8a3488e64811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64818 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229116.811772:0:14175:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe74420200/0x8e1c8a3488e64811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64818 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782229116.811821:0:14175:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782229116.811823:0:14175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782229116.811824:0:14175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782229116.811825:0:14175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782229116.811826:0:14175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782229116.811828:0:14175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782229116.811829:0:14175:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782229116.811830:0:14175:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782229116.811832:0:14175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782229116.811836:0:14175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782229116.811839:0:14175:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1782229116.811841:0:14175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782229116.811842:0:14175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782229116.811842:0:14175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782229116.811843:0:14175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782229116.811844:0:14175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782229116.811845:0:14175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782229116.811846:0:14175:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782229116.811846:0:14175:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782229116.811847:0:14175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782229116.811848:0:14175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782229116.811863:0:14175:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782229116.811873:0:14175:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329500160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782229116.811913:0:14175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229116.811930:0:14175:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe502856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229116.812387:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500160 00000100:00100000:1.0:1782229116.812393:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500160 00000100:00100000:1.0:1782229116.812453:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782229116.812460:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14175:x1868802329500160:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782229116.812480:0:14188:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782229116.812491:0:14188:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1782229116.813346:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782229116.813355:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7b63c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782229116.813359:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782229116.813363:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329499904:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1782229116.873623:0:14188:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782229116.873639:0:14188:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1782229116.873694:0:14209:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782229116.873699:0:14209:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782229116.873722:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.873741:0:14209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 12 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.873750:0:14209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.873791:0:14209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 12 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.873807:0:14209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 12 pid: 14188 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229116.873822:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14209:1868802329500288:0@lo:104: 00000100:00100000:0.0:1782229116.873887:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229116.873938:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe447e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1782229116.873975:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500288 00000100:00100000:0.0:1782229116.873982:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500288 00000100:00100000:0.0:1782229116.874029:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782229116.874037:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14209:x1868802329500288:12345-0@lo:104: 00010000:00010000:0.0:1782229116.874050:0:14176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.874098:0:14176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782229116.874104:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14209:x1868802329500288:12345-0@lo:104: Request processed in 68us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229116.874111:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1782229116.874141:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229116.874147:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.874154:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22600 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:0.0:1782229116.874158:0:14182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.874166:0:14182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782229116.874174:0:14182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782229116.874179:0:14182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782229116.874516:0:14182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.874525:0:14182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782229116.874636:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329500416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782229116.874669:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782229116.874724:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.874732:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e647f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e647fc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.874749:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229116.874750:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229116.874752:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229116.874800:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14209:1868802329500288:0@lo:104: 00010000:00010000:0.0:1782229116.874822:0:14209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.875157:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500416 00000100:00100000:1.0:1782229116.875163:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500416 00010000:00010000:1.0:1782229116.875185:0:14178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 13 pid: 14188 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.875225:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782229116.875232:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+13:3310:x1868802329500416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782229116.875242:0:14178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229116.875247:0:14178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 13 pid: 14188 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875258:0:14178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 13 pid: 14188 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875271:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e647fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e647f5 expref: 13 pid: 14188 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875284:0:14178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875292:0:14178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782229116.875305:0:14178:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001606626s 00010000:00010000:1.0:1782229116.875309:0:14178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875315:0:14178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875321:0:14178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875327:0:14178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875339:0:14178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229116.875343:0:14178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875351:0:14178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875363:0:14178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229116.875372:0:14178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229116.875462:0:14209:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.875470:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229116.875475:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e6482d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229116.879091:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:3310:x1868802329500416:12345-0@lo:103:ldlm_bl.0 Request processed in 3849us (4410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229116.879107:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782229116.879182:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329500416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782229116.892340:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14175:x1868802329500160:12345-0@lo:253:mount.lustre.0 Request processed in 79872us (80418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229116.892355:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782229116.892615:0:14175:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14175:1868802329500160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782229116.892628:0:14175:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782229116.892632:0:14175:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782229116.892633:0:14175:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782229116.892635:0:14175:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782229116.892636:0:14175:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782229116.892637:0:14175:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782229116.892639:0:14175:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782229116.892640:0:14175:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782229116.892642:0:14175:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782229116.892643:0:14175:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782229116.892645:0:14175:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782229116.892657:0:14175:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782229116.899279:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782229116.899875:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782229116.901041:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782229116.901374:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782229116.901977:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782229116.902273:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1782229116.903874:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1782229116.904126:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1782229116.904672:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1782229116.905059:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1782229116.905818:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1782229116.905990:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1782229116.938341:0:14175:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1782229116.938900:0:14175:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1782229116.939364:0:14231:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1782229116.939484:0:14231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1782229116.942299:0:14230:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1782229116.942315:0:14230:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1782229116.949741:0:14231:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:1.0:1782229116.949984:0:14175:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1782229116.950235:0:14175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1782229116.951195:0:14231:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782229116.951211:0:14231:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1782229116.951824:0:14175:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1782229116.951836:0:14175:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1782229116.952047:0:14175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782229116.955876:0:14175:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1782229116.957676:0:14175:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1782229116.957739:0:14175:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1782229116.959344:0:14175:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1782229116.965223:0:14175:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1782229117.005607:0:14175:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782229117.005648:0:14175:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb64481c77988 00100000:10000000:3.0:1782229117.005657:0:14175:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782229117.006245:0:14175:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782229117.006259:0:14175:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782229117.006280:0:14175:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782229117.006298:0:14175:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1782229117.435626:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782229117.691528:0:14190:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782229117.691536:0:14190:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fd42ec2800 from 6 10000000:01000000:0.0:1782229117.691542:0:14190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782229117.691590:0:14190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229117.691601:0:14190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229117.691611:0:14190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229117.691634:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329500544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782229117.691710:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229117.691754:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe447e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782229117.693266:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500544 00000100:00100000:3.0:1782229117.693277:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500544 00000100:00100000:3.0:1782229117.693350:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782229117.693360:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14190:x1868802329500544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782229117.693388:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229117.693405:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64834 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229117.693454:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 12 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229117.693464:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 12 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229117.693473:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916e00, rc 0) 00000100:00100000:3.0:1782229117.693679:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329500544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 320us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229117.693686:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782229117.693909:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329500544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782229117.693927:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229117.693936:0:14190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229117.694004:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329500672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782229117.694039:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229117.694079:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe447e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782229117.694121:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500672 00000100:00100000:2.0:1782229117.694134:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500672 00000100:00100000:2.0:1782229117.694158:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782229117.694164:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329500672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782229117.694177:0:14188:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782229117.694202:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782229117.694205:0:14188:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1782229117.694283:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329500672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229117.694290:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782229117.694532:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329500672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782229117.694569:0:14190:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782229117.694576:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229117.694583:0:14190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782229117.825822:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782229118.460046:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782229118.844172:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782229119.487044:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229120.508049:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229121.533332:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782229122.171739:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782229122.171746:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782229122.171749:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782229122.171752:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782229122.171755:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782229122.171758:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782229122.171762:0:37:0:(import.c:65:import_set_state_nolock()) ffff98fe7b63c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782229122.171774:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98fe7b63c000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782229122.171800:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782229122.171803:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe77c0b800 x1868802329500928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782229122.171819:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329500800:0@lo:400:kworker.0 00000100:00100000:0.0:1782229122.171915:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229122.171992:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500800 00000100:00100000:0.0:1782229122.172000:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500800 00000100:00100000:0.0:1782229122.172051:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782229122.172063:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:3310:x1868802329500800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229122.172127:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:3310:x1868802329500800:12345-0@lo:400:kworker.0 Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229122.172135:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782229122.172190:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329500800:0@lo:400:kworker.0 00000100:00100000:1.0:1782229122.172416:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329500928:0@lo:38:kworker.0 00000100:00100000:1.0:1782229122.172694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229122.177679:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329500928 00000100:00100000:0.0:1782229122.177691:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329500928 00000100:00100000:0.0:1782229122.177734:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229122.177743:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1868802329500928:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1782229122.177781:0:14195:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:0.0:1782229122.177818:0:14195:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8e1c8a3488e64842 00000004:00100000:0.0:1782229122.177843:0:14195:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782229122.178000:0:14195:0:(import.c:65:import_set_state_nolock()) ffff98fd42a3c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782229122.178097:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1868802329500928:12345-0@lo:38:kworker.0 Request processed in 352us (5401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229122.178106:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782229122.178202:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fe77c0b800 x1868802329500928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782229132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782229122.178224:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1782229122.178235:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782229122.178241:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782229122.178244:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe7b63c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782229122.178251:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1868802329500928:0@lo:38:kworker.0 00000001:02000400:0.0:1782229122.193067:0:14474:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782229122.556943:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229123.579722:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229124.603884:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782229125.444881:0:14624:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff052ef7f0 20000000:00000080:3.0:1782229125.444905:0:14624:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fe75669400 uarg=0000000000000000 20000000:01000000:3.0:1782229125.445023:0:14624:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782229125.445032:0:14624:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782229125.445039:0:14624:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1782229125.446594:0:14625:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1782229125.449786:0:14624:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782229125.470796:0:14624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782229125.471505:0:14624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229125.471538:0:14624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 11 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229125.471550:0:14624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229125.471613:0:14624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 11 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229125.471634:0:14624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 11 pid: 14188 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229125.471652:0:14624:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14624:1868802329501056:0@lo:104: 00000100:00100000:2.0:1782229125.471762:0:14624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229125.471920:0:14624:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe69154240 going to sleep for 11 seconds 00000100:00100000:0.0:1782229125.474776:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329501056 00000100:00100000:0.0:1782229125.474792:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329501056 00000100:00100000:0.0:1782229125.474934:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229125.474946:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14624:x1868802329501056:12345-0@lo:104: 00010000:00010000:0.0:1782229125.474971:0:14177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229125.475251:0:14624:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14624:1868802329501056:0@lo:104: 00010000:00010000:3.0:1782229125.475285:0:14624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229125.475784:0:14177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782229125.475795:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14624:x1868802329501056:12345-0@lo:104: Request processed in 851us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229125.475805:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782229125.475883:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229125.475893:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.475977:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22400 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229125.475983:0:14181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.475993:0:14181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229125.476001:0:14181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229125.476008:0:14181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782229125.476316:0:14181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.476324:0:14181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782229125.476370:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.476379:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe59e22400/0x8e1c8a3488e64803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6480a expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.476401:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229125.476403:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229125.476405:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229125.476474:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329501184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782229125.476543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229125.476830:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329501184 00000100:00100000:1.0:1782229125.476849:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329501184 00010000:00010000:1.0:1782229125.476881:0:14179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 12 pid: 14188 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229125.478651:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782229125.478677:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:3308:x1868802329501184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782229125.478702:0:14179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229125.478712:0:14179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 12 pid: 14188 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478733:0:14179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 12 pid: 14188 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478756:0:14179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe81dccc00/0x8e1c8a3488e6480a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e64803 expref: 12 pid: 14188 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478775:0:14179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478805:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478828:0:14179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478875:0:14179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478882:0:14179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478889:0:14179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.478896:0:14179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229125.479717:0:14179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.479730:0:14179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.479757:0:14179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229125.479773:0:14179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229125.479887:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:3308:x1868802329501184:12345-0@lo:103:ldlm_bl.0 Request processed in 1221us (3343us total) trans 0 rc 0/0 00010000:00010000:2.0:1782229125.480489:0:14624:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229125.480502:0:14624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229125.480509:0:14624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe81dcc600/0x8e1c8a3488e64849 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229125.483323:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229125.483710:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329501184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782229125.629202:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229126.267653:0:3307:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229116/real 1782229116] req@ffff98fe446ac380 x1868802329498240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229126.267713:0:3307:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98fe446ac380 x1868802329498240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229126.267726:0:3307:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229116/real 1782229116] req@ffff98fe446ad180 x1868802329498112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229126.267740:0:3307:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98fe446ad180 x1868802329498112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782229126.267762:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782229126.267791:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782229126.267796:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329498240:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782229126.267803:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe50810000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782229126.267809:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782229126.267812:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329498112:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782229126.267965:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782229126.267971:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782229126.267974:0:37:0:(import.c:65:import_set_state_nolock()) ffff98fe50810000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782229126.267980:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:0.0:1782229126.267986:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782229126.267994:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98fe50810000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782229126.268019:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fd42a37800 x1868802329501440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782229126.268032:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782229126.268035:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782229126.268037:0:37:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782229126.268040:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:0.0:1782229126.268043:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782229126.268046:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98fe77bc9800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782229126.268057:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fd42a36680 x1868802329501568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782229126.268099:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782229126.268114:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329501312:0@lo:400:kworker.0 00000100:00100000:0.0:1782229126.268228:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229126.268293:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329501696:0@lo:400:kworker.0 00000100:00100000:0.0:1782229126.268325:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229126.268369:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329501312 00000100:00100000:0.0:1782229126.268378:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329501312 00000100:00100000:0.0:1782229126.268466:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782229126.268477:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:3308:x1868802329501312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229126.268533:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:3308:x1868802329501312:12345-0@lo:400:kworker.0 Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229126.268541:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782229126.268595:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329501312:0@lo:400:kworker.0 00000100:00100000:0.0:1782229126.268616:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329501440:0@lo:8:kworker.0 00000400:00000100:0.0:1782229126.268637:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868802329501440 offset 0 length 520: 4 00000100:00100000:0.0:1782229126.268648:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329501568:0@lo:8:kworker.0 00000400:00000100:0.0:1782229126.268663:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868802329501568 offset 0 length 520: 4 00000100:00100000:1.0:1782229126.269101:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329501696 00000100:00100000:1.0:1782229126.269108:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329501696 00000100:00100000:1.0:1782229126.270026:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782229126.270038:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329501696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229126.273935:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329501696:12345-0@lo:400:kworker.0 Request processed in 3882us (5591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229126.273955:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782229126.281518:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fd42a37480 x1868802329501696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229126.281549:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329501696:0@lo:400:kworker.0 00010000:00010000:1.0:1782229126.656241:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782229126.971559:0:14190:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782229126.971570:0:14190:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fd42ec2800 from 10 10000000:01000000:3.0:1782229126.971578:0:14190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782229126.971644:0:14190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229126.971659:0:14190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229126.971673:0:14190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229126.971708:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329501824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782229126.971817:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229126.971940:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43e60900 going to sleep for 11 seconds 00000100:00100000:2.0:1782229126.976500:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329501824 00000100:00100000:2.0:1782229126.976518:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329501824 00000100:00100000:2.0:1782229126.976591:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782229126.976601:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+11:14190:x1868802329501824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782229126.976623:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229126.976649:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64850 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229126.976683:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 12 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229126.976695:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 12 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229126.976705:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcd400, rc 0) 00000100:00100000:2.0:1782229126.976817:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329501824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (5000us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229126.976825:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782229126.976894:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329501824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782229126.976929:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229126.976939:0:14190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229126.977259:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782229126.977301:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229126.977344:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41e65cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229126.977413:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329501952 00000100:00100000:0.0:1782229126.977418:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329501952 00000100:00100000:0.0:1782229126.977486:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782229126.977494:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329501952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782229126.977833:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329501952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229126.977850:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782229126.977948:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782229126.977986:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329502080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782229126.978230:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229126.978263:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fd41e65cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229126.978318:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502080 00000100:00100000:0.0:1782229126.978323:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502080 00000100:00100000:0.0:1782229126.978361:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782229126.978389:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329502080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782229126.978592:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14190:x1868802329502080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229126.978599:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782229126.980197:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329502080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782229126.981573:0:14684:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782229126.982345:0:14190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782229126.982375:0:14190:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782229126.982391:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229126.982405:0:14190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229127.679825:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782229128.068723:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782229128.699600:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229129.726680:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782229130.550852:0:14826:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782229130.550856:0:14826:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782229130.551085:0:14826:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98fe6dd02000 00000020:01000004:2.0:1782229130.551101:0:14826:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782229130.551112:0:14826:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782229130.551126:0:14826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98fe7fff99c0) 00000020:00000080:2.0:1782229130.551148:0:14826:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782229130.593421:0:14826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1782229130.593699:0:14826:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1782229130.594502:0:14826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1782229130.595749:0:14826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1782229130.596725:0:14826:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1782229130.597341:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1782229130.597529:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1782229130.597830:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1782229130.599455:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 416: rc = 0 00100000:10000000:0.0:1782229130.600117:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 416: rc = 0 00100000:10000000:0.0:1782229130.600633:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 416: rc = 0 00100000:10000000:0.0:1782229130.601022:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 416: rc = 0 00100000:10000000:0.0:1782229130.601354:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 416: rc = 0 00100000:10000000:0.0:1782229130.601744:0:14826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 416: rc = 0 00000020:00000080:0.0:1782229130.602656:0:14826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1782229130.602667:0:14826:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782229130.602678:0:14826:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e1c8a3488e64865 00000020:01000004:0.0:1782229130.602686:0:14826:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1782229130.602706:0:14826:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.122@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782229130.602709:0:14826:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782229130.602714:0:14826:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1782229130.602718:0:14826:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1782229130.602740:0:14826:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98fe66023380) 00000020:00000080:0.0:1782229130.602755:0:14826:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1782229130.603977:0:14826:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782229130.604136:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1782229130.604143:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1782229130.610670:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782229130.610783:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1782229130.611142:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1782229130.611148:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782229130.613189:0:14826:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782229130.613584:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782229130.613592:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782229130.614143:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782229130.614150:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782229130.636049:0:14826:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782229130.636274:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782229130.636281:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782229130.637868:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782229130.637878:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1782229130.638812:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782229130.638820:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1782229130.641882:0:14826:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782229130.642073:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782229130.642081:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782229130.643896:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782229130.643906:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782229130.720391:0:14826:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782229130.720597:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1782229130.720604:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1782229130.722312:0:14826:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1782229130.722322:0:14826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1782229130.725537:0:14826:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1782229130.725563:0:14826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1782229130.725570:0:14826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782229130.734179:0:14826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782229130.734218:0:14826:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.122@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1782229130.734223:0:14826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782229130.734225:0:14826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782229130.734226:0:14826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782229130.734227:0:14826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782229130.734228:0:14826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782229130.734230:0:14826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782229130.734236:0:14826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782229130.734238:0:14826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782229130.734239:0:14826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782229130.734243:0:14826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1782229130.734245:0:14826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782229130.734246:0:14826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782229130.734247:0:14826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782229130.734248:0:14826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782229130.734248:0:14826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782229130.734249:0:14826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782229130.734250:0:14826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782229130.734251:0:14826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782229130.734252:0:14826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782229130.734288:0:14826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782229130.734310:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782229130.734386:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229130.734472:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42f43e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782229130.734547:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502208 00000100:00100000:2.0:1782229130.734555:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502208 00000100:00100000:2.0:1782229130.734611:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782229130.734621:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14826:x1868802329502208:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782229130.734661:0:14187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782229130.734669:0:14187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1782229130.734673:0:14187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1782229130.748245:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229130.752712:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14826:x1868802329502208:12345-0@lo:253:mount.lustre.0 Request processed in 18084us (18318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229130.752750:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782229130.752854:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782229130.752871:0:14826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782229130.752874:0:14826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782229130.752876:0:14826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782229130.752877:0:14826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782229130.752878:0:14826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782229130.752879:0:14826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782229130.752880:0:14826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782229130.752881:0:14826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782229130.752883:0:14826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782229130.752884:0:14826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782229130.752906:0:14826:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fe6dd02000 from lustre-OST0000 10000000:01000000:0.0:1782229130.753392:0:14826:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782229130.753396:0:14826:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782229130.753402:0:14826:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98fe7fff8000 local copy 00010000:00010000:0.0:1782229130.753412:0:14826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229130.753671:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229130.753717:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229130.753882:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4396ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1782229130.754692:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502336 00000100:00100000:2.0:1782229130.754702:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502336 00000100:00100000:2.0:1782229130.754767:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782229130.754777:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14826:x1868802329502336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229130.755349:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14826:x1868802329502336:12345-0@lo:501:mount.lustre.0 Request processed in 572us (1629us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782229130.755359:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782229130.755946:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502336:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782229130.755971:0:14826:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782229130.756369:0:14826:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782229130.756380:0:14826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.756390:0:14826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229130.756424:0:14826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fe6dd02000 10000000:01000000:1.0:1782229130.756458:0:14826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782229130.756464:0:14826:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98fe7fff8000 10000000:01000000:1.0:1782229130.756466:0:14826:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782229130.756469:0:14826:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff98fe7fff8000 from 1 10000000:01000000:1.0:1782229130.756472:0:14826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782229130.756503:0:14826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420000/0x8e1c8a3488e64873 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.756510:0:14826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe74420000/0x8e1c8a3488e64873 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.756520:0:14826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe74420000/0x8e1c8a3488e64873 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229130.756540:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782229130.756586:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.756666:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b480 going to sleep for 11 seconds 00000100:00100000:2.0:1782229130.757232:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502464 00000100:00100000:2.0:1782229130.757240:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502464 00000100:00100000:2.0:1782229130.757395:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782229130.757404:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+12:14826:x1868802329502464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782229130.757418:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229130.757458:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe81dcda00/0x8e1c8a3488e6487a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64873 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.757482:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe81dcda00/0x8e1c8a3488e6487a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64873 expref: 13 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.757494:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe81dcda00/0x8e1c8a3488e6487a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64873 expref: 13 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.757502:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe81dcda00, rc 0) 00000100:00100000:2.0:1782229130.757611:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+13:14826:x1868802329502464:12345-0@lo:101:mount.lustre.0 Request processed in 207us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229130.757619:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782229130.757956:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229130.757973:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe74420000/0x8e1c8a3488e64873 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6487a expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.757981:0:14826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe74420000/0x8e1c8a3488e64873 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e6487a expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229130.758003:0:14826:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782229130.758182:0:14826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420000/0x8e1c8a3488e64873 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6487a expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.758205:0:14826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe74420000/0x8e1c8a3488e64873 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e6487a expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229130.758213:0:14826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782229130.758217:0:14826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782229130.758223:0:14826:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782229130.758225:0:14826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782229130.758247:0:14826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420600/0x8e1c8a3488e64881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.758255:0:14826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe74420600/0x8e1c8a3488e64881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.758273:0:14826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe74420600/0x8e1c8a3488e64881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229130.758290:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782229130.758325:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.758363:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038b480 going to sleep for 11 seconds 00000100:00100000:3.0:1782229130.758499:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502592 00000100:00100000:3.0:1782229130.758505:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502592 00000100:00100000:3.0:1782229130.758545:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782229130.758553:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+13:14826:x1868802329502592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782229130.758563:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229130.758575:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e64888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64881 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229130.758593:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e64888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64881 expref: 14 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229130.758602:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916000/0x8e1c8a3488e64888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64881 expref: 14 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229130.758610:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916000, rc 0) 00000100:00100000:3.0:1782229130.758641:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329502592:12345-0@lo:101:mount.lustre.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229130.758647:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782229130.758855:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229130.758867:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe74420600/0x8e1c8a3488e64881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64888 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.758876:0:14826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe74420600/0x8e1c8a3488e64881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64888 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782229130.760428:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782229130.761845:0:14826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782229130.762643:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1782229130.762700:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1782229130.762741:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1782229130.762784:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1782229130.762813:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1782229130.762839:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1782229130.763839:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1782229130.763858:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1782229130.764566:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782229130.764635:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.764749:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5038bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782229130.764798:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502720 00000100:00100000:3.0:1782229130.764806:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502720 00000100:00100000:3.0:1782229130.764903:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782229130.764913:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329502720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782229130.767627:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329502720:12345-0@lo:501:mount.lustre.0 Request processed in 2708us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229130.767642:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782229130.767770:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229130.767823:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782229130.767882:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229130.768417:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4396cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782229130.768510:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502848 00000100:00100000:2.0:1782229130.768517:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502848 00000100:00100000:1.0:1782229130.768596:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782229130.768607:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329502848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782229130.769206:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329502848:12345-0@lo:503:mount.lustre.0 Request processed in 599us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.769214:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782229130.769426:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782229130.770344:0:14826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782229130.770424:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782229130.770825:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229130.770864:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4396cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782229130.771216:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329502976 00000100:00100000:1.0:1782229130.771223:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329502976 00000100:00100000:1.0:1782229130.771280:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782229130.771290:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329502976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229130.771567:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329502976:12345-0@lo:502:mount.lustre.0 Request processed in 277us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.771575:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782229130.771889:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329502976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782229130.772816:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1782229130.772888:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1782229130.772926:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1782229130.773320:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1782229130.773355:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1782229130.773383:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1782229130.773425:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1782229130.773484:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1782229130.773515:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1782229130.773559:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1782229130.773593:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1782229130.773641:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1782229130.773695:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782229130.773775:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229130.774560:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4396cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782229130.774671:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329503104 00000100:00100000:1.0:1782229130.774678:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329503104 00000100:00100000:1.0:1782229130.774717:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782229130.774724:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329503104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229130.774963:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329503104:12345-0@lo:502:mount.lustre.0 Request processed in 230us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.774977:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782229130.777194:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782229130.777360:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1782229130.777377:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1782229130.780784:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782229130.780796:0:14840:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782229130.780804:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782229130.780806:0:14840:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782229130.780812:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782229130.780838:0:14840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98fe6f6c8000) 00000020:00000080:2.0:1782229130.780861:0:14840:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782229130.780870:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782229130.781164:0:14840:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fe6dd02000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782229130.781172:0:14840:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782229130.781179:0:14840:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8e1c8a3488e64896 00010000:00010000:2.0:1782229130.787770:0:14840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1782229130.789865:0:14840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1782229130.794781:0:14840:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782229130.797632:0:14840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782229130.797643:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229130.797650:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.797652:0:14840:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782229130.797656:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782229130.797659:0:14840:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1782229130.797660:0:14840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782229130.797662:0:14840:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782229130.797663:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782229130.797665:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.797666:0:14840:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782229130.797668:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229130.797671:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.797673:0:14840:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782229130.797675:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782229130.797677:0:14840:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782229130.797680:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229130.797682:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.797683:0:14840:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782229130.797685:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229130.797687:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.797688:0:14840:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782229130.797691:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782229130.797772:0:14840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229130.797776:0:14840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.797777:0:14840:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782229130.797781:0:14840:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1782229130.797981:0:14826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1782229130.798022:0:14826:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782229130.798042:0:14826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74420600/0x8e1c8a3488e64881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64888 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.798054:0:14826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe74420600/0x8e1c8a3488e64881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64888 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782229130.798063:0:14826:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe6dd02000 from 1 10000000:01000000:2.0:1782229130.798066:0:14826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782229130.798215:0:14826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.798223:0:14826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.798234:0:14826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229130.798269:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782229130.798337:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229130.798381:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6f201e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782229130.801210:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329503232 00000100:00100000:0.0:1782229130.801223:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329503232 00000100:00100000:0.0:1782229130.801282:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782229130.801293:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+14:14826:x1868802329503232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782229130.801309:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229130.801329:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e6489d expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229130.801356:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 15 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229130.801368:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 15 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229130.801377:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22200, rc 0) 00000100:00100000:0.0:1782229130.801463:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503232:12345-0@lo:101:mount.lustre.0 Request processed in 172us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229130.801471:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782229130.802154:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782229130.802177:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.802187:0:14826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229130.802773:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1782229130.803212:0:14826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782229130.803518:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1782229130.803566:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1782229130.803631:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1782229130.803639:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1782229130.803711:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229130.803786:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229130.803830:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6f201e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782229130.805164:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329503360 00000100:00100000:0.0:1782229130.805175:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329503360 00000100:00100000:0.0:1782229130.805231:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782229130.805241:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229130.805521:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503360:12345-0@lo:501:mount.lustre.0 Request processed in 281us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229130.805530:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782229130.813384:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229130.813460:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782229130.813540:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229130.813574:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6f201e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782229130.819778:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329503488 00000100:00100000:3.0:1782229130.819806:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329503488 00000100:00100000:3.0:1782229130.819868:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782229130.819878:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782229130.820282:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503488:12345-0@lo:503:mount.lustre.0 Request processed in 404us (6740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229130.820292:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782229130.820542:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782229130.822539:0:14826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782229130.822628:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229130.822706:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.822762:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ed9600 going to sleep for 11 seconds 00000100:00100000:0.0:1782229130.822902:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329503616 00000100:00100000:0.0:1782229130.822909:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329503616 00000100:00100000:0.0:1782229130.822981:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782229130.822990:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782229130.823462:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503616:12345-0@lo:502:mount.lustre.0 Request processed in 471us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229130.823471:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782229130.824387:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782229130.825198:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782229130.825359:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782229130.825417:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782229130.825633:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782229130.825670:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782229130.825722:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782229130.825770:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782229130.825806:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1782229130.825849:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782229130.825933:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229130.825984:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe4396c840 going to sleep for 11 seconds 00000100:00100000:1.0:1782229130.826213:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329503744 00000100:00100000:1.0:1782229130.826221:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329503744 00000100:00100000:1.0:1782229130.826281:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782229130.826290:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229130.826585:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503744:12345-0@lo:502:mount.lustre.0 Request processed in 295us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.826593:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782229130.830782:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782229130.831323:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782229130.831343:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782229130.833553:0:14844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229130.833567:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.833569:0:14844:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782229130.833576:0:14844:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe6dd02000 00000020:00000080:0.0:1782229130.833579:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782229130.833586:0:14844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229130.833589:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.833591:0:14844:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782229130.833594:0:14844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229130.833596:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.833597:0:14844:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782229130.833601:0:14844:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fe6dd02000 00000020:00000080:0.0:1782229130.833602:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782229130.833674:0:14844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229130.833678:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.833679:0:14844:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782229130.833681:0:14844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782229130.833684:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.833686:0:14844:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782229130.833690:0:14844:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98fe6dd02000 00000020:00000080:0.0:1782229130.833692:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782229130.833743:0:14844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782229130.833747:0:14844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782229130.833748:0:14844:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782229130.833752:0:14844:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782229130.833973:0:14826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782229130.834013:0:14826:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782229130.834035:0:14826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229130.834047:0:14826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782229130.834215:0:14826:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782229130.834218:0:14826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fe6dd02000 10000000:01000000:3.0:1782229130.834222:0:14826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fe6dd02000 10000000:01000000:3.0:1782229130.834226:0:14826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782229130.834232:0:14826:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fe6dd02000 from 1 10000000:01000000:3.0:1782229130.834234:0:14826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782229130.834271:0:14826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e648ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229130.834279:0:14826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e648ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229130.834289:0:14826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e648ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229130.834313:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782229130.834387:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229130.834453:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446670c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229130.834598:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329503872 00000100:00100000:1.0:1782229130.834606:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329503872 00000100:00100000:1.0:1782229130.834656:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782229130.834666:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329503872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229130.834679:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229130.834693:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe74421600/0x8e1c8a3488e648b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e648ab expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.834715:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe74421600/0x8e1c8a3488e648b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e648ab expref: 16 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.834725:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe74421600/0x8e1c8a3488e648b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e648ab expref: 16 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.834751:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74421600, rc 0) 00000100:00100000:1.0:1782229130.834793:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329503872:12345-0@lo:101:mount.lustre.0 Request processed in 129us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.834800:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782229130.834853:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329503872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229130.834868:0:14826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e648ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648b2 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.834876:0:14826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e648ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e648b2 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782229130.835851:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1782229130.836658:0:14826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782229130.837217:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782229130.837268:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782229130.837304:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782229130.837350:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782229130.837386:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782229130.837594:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782229130.837635:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782229130.837675:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782229130.837723:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782229130.837773:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782229130.837826:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782229130.837876:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782229130.837912:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782229130.838246:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782229130.838300:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782229130.838348:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782229130.838384:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782229130.838456:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782229130.838491:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782229130.838522:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782229130.838564:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782229130.838599:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782229130.838634:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782229130.838699:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782229130.838755:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1782229130.838792:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1782229130.838859:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1782229130.838895:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1782229130.839269:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1782229130.839279:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1782229130.839378:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782229130.839460:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.839510:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ed9240 going to sleep for 11 seconds 00000100:00100000:2.0:1782229130.839529:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504000 00000100:00100000:2.0:1782229130.839538:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504000 00000100:00100000:2.0:1782229130.839592:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782229130.839611:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229130.839873:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504000:12345-0@lo:501:mount.lustre.0 Request processed in 263us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229130.839881:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782229130.839975:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782229130.840016:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782229130.840058:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.840298:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ed9240 going to sleep for 11 seconds 00000100:00100000:3.0:1782229130.840359:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504128 00000100:00100000:3.0:1782229130.840364:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504128 00000100:00100000:3.0:1782229130.840397:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782229130.840404:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504128:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782229130.840571:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504128:12345-0@lo:503:mount.lustre.0 Request processed in 167us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229130.840579:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782229130.842570:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782229130.843133:0:14826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782229130.843227:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782229130.843299:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229130.843355:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6f201cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229130.843356:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504256 00000100:00100000:1.0:1782229130.843363:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504256 00000100:00100000:1.0:1782229130.843412:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782229130.843422:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229130.843694:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504256:12345-0@lo:502:mount.lustre.0 Request processed in 272us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.843703:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782229130.843737:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782229130.844053:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1782229130.844096:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1782229130.844123:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1782229130.844161:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1782229130.844191:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1782229130.844427:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1782229130.844580:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1782229130.844634:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1782229130.844712:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1782229130.844778:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1782229130.844814:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1782229130.844861:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782229130.847499:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782229130.847608:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782229130.847719:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782229130.847980:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782229130.848052:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782229130.848123:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782229130.848180:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782229130.848221:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782229130.848328:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782229130.848372:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782229130.848449:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782229130.848513:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782229130.848798:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782229130.848836:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782229130.848955:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782229130.848996:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782229130.849029:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782229130.849079:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782229130.849116:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782229130.849152:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782229130.849191:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782229130.849255:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782229130.849354:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782229130.849422:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782229130.849791:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782229130.849829:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782229130.850011:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782229130.850088:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782229130.850145:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782229130.850223:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229130.850451:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44667780 going to sleep for 11 seconds 00000100:00100000:1.0:1782229130.851812:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504384 00000100:00100000:1.0:1782229130.851823:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504384 00000100:00100000:1.0:1782229130.851891:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782229130.851901:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229130.853770:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504384:12345-0@lo:502:mount.lustre.0 Request processed in 1864us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.853781:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782229130.853855:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782229130.854271:0:14826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1782229130.854411:0:14826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1782229130.859621:0:14849:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782229130.859651:0:14849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98fd42a719c0) 00000020:00000080:1.0:1782229130.859673:0:14849:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1782229130.859831:0:14849:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fe6dd02000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782229130.859835:0:14849:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fe6dd02000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782229130.859838:0:14849:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fe6dd02000 3 00010000:00080000:1.0:1782229130.859868:0:14849:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fd4130a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.122@tcp at head 00010000:00010000:1.0:1782229130.861570:0:14849:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1782229130.861674:0:14849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782229130.861707:0:14849:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782229130.861718:0:14849:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8e1c8a3488e648c0 00000100:00080000:1.0:1782229130.861739:0:14849:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782229130.861745:0:14849:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98fd4130a000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:1.0:1782229130.861782:0:14849:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe446ac000 x1868802329504512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782229130.861818:0:14849:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782229130.861844:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782229130.861855:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782229130.861858:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782229130.861861:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782229130.861934:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329504640:0@lo:400:kworker.0 00000100:00100000:1.0:1782229130.861999:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.862073:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504640 00000100:00100000:1.0:1782229130.862080:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504640 00000100:00100000:1.0:1782229130.862124:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782229130.862133:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329504640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229130.862185:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329504640:12345-0@lo:400:kworker.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.862193:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782229130.862228:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fe446ac700 x1868802329504640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229130.862241:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329504640:0@lo:400:kworker.0 00000100:00100000:2.0:1782229130.866869:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1868802329504512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782229130.866952:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.868258:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504512 00000100:00100000:1.0:1782229130.868326:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504512 00000100:00100000:1.0:1782229130.868372:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782229130.868381:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1868802329504512:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782229130.868407:0:14193:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1782229130.868474:0:14193:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8e1c8a3488e648c7 00000004:00100000:1.0:1782229130.868490:0:14193:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782229130.868522:0:14193:0:(import.c:65:import_set_state_nolock()) ffff98fd420c5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782229130.868717:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1868802329504512:12345-0@lo:38:llog_process_th.0 Request processed in 335us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.868746:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1782229130.868923:0:14849:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1782229130.868924:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fe446ac000 x1868802329504512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782229140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229130.868939:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782229130.868957:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1782229130.868965:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782229130.868970:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782229130.868972:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fd4130a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782229130.868979:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1868802329504512:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1782229130.869217:0:14826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782229130.869249:0:14826:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782229130.869278:0:14826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e648ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648b2 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.869296:0:14826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917e00/0x8e1c8a3488e648ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648b2 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782229130.869344:0:14826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782229130.869347:0:14826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782229130.869349:0:14826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782229130.869350:0:14826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782229130.869351:0:14826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782229130.869352:0:14826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782229130.869354:0:14826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782229130.869356:0:14826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782229130.869357:0:14826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782229130.869361:0:14826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1782229130.869363:0:14826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782229130.869365:0:14826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782229130.869365:0:14826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782229130.869367:0:14826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782229130.869368:0:14826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782229130.869369:0:14826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782229130.869370:0:14826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782229130.869371:0:14826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782229130.869372:0:14826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782229130.869391:0:14826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782229130.869408:0:14826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782229130.869479:0:14826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229130.869511:0:14826:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6f201900 going to sleep for 11 seconds 00000100:00100000:3.0:1782229130.869751:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504768 00000100:00100000:3.0:1782229130.869757:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504768 00000100:00100000:3.0:1782229130.869802:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782229130.869811:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14826:x1868802329504768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782229130.869838:0:14187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782229130.869852:0:14187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782229130.909493:0:14187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782229130.909516:0:14187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782229130.909580:0:14209:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782229130.909586:0:14209:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782229130.909611:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229130.909630:0:14209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 16 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229130.909640:0:14209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229130.909700:0:14209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 16 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229130.909717:0:14209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 16 pid: 14187 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229130.909742:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14209:1868802329504896:0@lo:104: 00000100:00100000:0.0:1782229130.909813:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229130.909862:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe587a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1782229130.910408:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329504896 00000100:00100000:3.0:1782229130.910417:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329504896 00000100:00100000:2.0:1782229130.911065:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782229130.911076:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14209:x1868802329504896:12345-0@lo:104: 00010000:00010000:2.0:1782229130.911091:0:14176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229130.911182:0:14176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782229130.911197:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14209:x1868802329504896:12345-0@lo:104: Request processed in 123us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229130.911205:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782229130.911257:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229130.911264:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911272:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23600 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229130.911276:0:14182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911285:0:14182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229130.911293:0:14182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229130.911298:0:14182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782229130.911335:0:14182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911342:0:14182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782229130.911362:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911369:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e64834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e6483b expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911383:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229130.911385:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229130.911387:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229130.911418:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329505024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782229130.911490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229130.911541:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505024 00000100:00100000:1.0:1782229130.911547:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505024 00010000:00010000:1.0:1782229130.911564:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 17 pid: 14187 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229130.911582:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782229130.911588:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:3308:x1868802329505024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782229130.911598:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229130.911602:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 17 pid: 14187 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911614:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 17 pid: 14187 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911631:0:14180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911639:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782229130.911653:0:14180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002067942s 00010000:00010000:1.0:1782229130.911657:0:14180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911663:0:14180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911669:0:14180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911684:0:14180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911689:0:14180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229130.911693:0:14180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911700:0:14180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911709:0:14180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911719:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229130.911761:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:3308:x1868802329505024:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229130.911768:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782229130.911823:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329505024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782229130.911857:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e6483b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e64834 expref: 16 pid: 14187 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229130.911868:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14209:1868802329504896:0@lo:104: 00010000:00010000:1.0:1782229130.911882:0:14209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911902:0:14209:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911921:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229130.911928:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e648ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229130.919111:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14826:x1868802329504768:12345-0@lo:253:mount.lustre.0 Request processed in 49293us (49622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229130.919132:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782229130.919226:0:14826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14826:1868802329504768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782229130.919242:0:14826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782229130.919246:0:14826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782229130.919248:0:14826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782229130.919249:0:14826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782229130.919250:0:14826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782229130.919252:0:14826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782229130.919253:0:14826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782229130.919255:0:14826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782229130.919256:0:14826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782229130.919258:0:14826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782229130.919271:0:14826:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782229130.928205:0:14826:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782229130.928382:0:14826:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782229130.928564:0:14826:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782229130.928717:0:14826:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782229130.928900:0:14826:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782229130.929117:0:14826:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782229130.932866:0:14826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1782229130.997607:0:14826:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782229130.997616:0:14826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782229130.997654:0:14826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782229130.997711:0:14826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782229130.997743:0:14826:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782229130.997772:0:14826:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1782229131.777097:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782229132.226915:0:14190:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782229132.226922:0:14190:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fd42ec2800 from 7 10000000:01000000:1.0:1782229132.226928:0:14190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782229132.226971:0:14190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229132.226983:0:14190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229132.226994:0:14190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229132.227016:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329505152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782229132.227076:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229132.227115:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b780 going to sleep for 11 seconds 00000100:00100000:1.0:1782229132.227136:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505152 00000100:00100000:1.0:1782229132.227142:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505152 00000100:00100000:1.0:1782229132.227192:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782229132.227202:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+15:14190:x1868802329505152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782229132.227215:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229132.227228:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e648d5 expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229132.227262:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 16 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229132.227272:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 16 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229132.227280:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe74420400, rc 0) 00000100:00100000:1.0:1782229132.227316:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14190:x1868802329505152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229132.227322:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782229132.227364:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329505152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782229132.227376:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229132.227384:0:14190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229132.227423:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329505280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782229132.227485:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229132.227504:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782229132.228643:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505280 00000100:00100000:2.0:1782229132.228650:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505280 00000100:00100000:2.0:1782229132.228693:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782229132.228711:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14190:x1868802329505280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782229132.228728:0:14186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782229132.228745:0:14186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782229132.228748:0:14186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1782229132.228839:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14190:x1868802329505280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229132.228847:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782229132.228886:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329505280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782229132.228949:0:14190:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782229132.228956:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229132.228975:0:14190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229132.795890:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229133.822933:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229134.844595:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229135.868688:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782229135.999683:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782229135.999690:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782229135.999692:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782229135.999695:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782229135.999737:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3309:1868802329505408:0@lo:400:kworker.0 00000100:00100000:0.0:1782229136.000224:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329505536:0@lo:400:kworker.0 00000100:00100000:0.0:1782229136.000280:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229136.000641:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329505664:0@lo:400:kworker.0 00000100:00100000:0.0:1782229136.000681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229136.006755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229136.007027:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505408 00000100:00100000:2.0:1782229136.007036:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505408 00000100:00100000:2.0:1782229136.007086:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782229136.007095:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:3309:x1868802329505408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229136.007153:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:3309:x1868802329505408:12345-0@lo:400:kworker.0 Request processed in 60us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229136.007159:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782229136.007208:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3309:1868802329505408:0@lo:400:kworker.0 00000100:00100000:3.0:1782229136.009334:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505536 00000100:00100000:3.0:1782229136.009346:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505536 00000100:00100000:3.0:1782229136.009393:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505664 00000100:00100000:3.0:1782229136.009405:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505664 00000100:00100000:3.0:1782229136.009449:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782229136.009458:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329505536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229136.009550:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329505536:12345-0@lo:400:kworker.0 Request processed in 93us (9269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229136.009557:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782229136.009571:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782229136.009577:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329505664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229136.009609:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1868802329505664:12345-0@lo:400:kworker.0 Request processed in 32us (8928us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229136.009615:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1782229136.009660:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782229136.009710:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fd42a34e00 x1868802329505536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229136.009725:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329505536:0@lo:400:kworker.0 00010000:00080000:3.0:1782229136.009764:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fd42a34000 x1868802329505664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229136.010968:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1868802329505664:0@lo:400:kworker.0 00010000:00010000:0.0:1782229136.892743:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782229137.575812:0:15193:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782229137.918671:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782229138.303302:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782229138.943020:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229139.964471:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229140.987925:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782229141.119324:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782229141.119332:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782229141.119334:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782229141.119337:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782229141.119340:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329505792:0@lo:400:kworker.0 00000100:00100000:2.0:1782229141.119381:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329505920:0@lo:400:kworker.0 00000100:00100000:1.0:1782229141.120962:0:3307:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229126/real 1782229126] req@ffff98fd42a37800 x1868802329501440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229141 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782229141.121125:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229141.122417:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329506048:0@lo:400:kworker.0 00000100:00100000:2.0:1782229141.122456:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505920 00000100:00100000:2.0:1782229141.122466:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505920 00000100:00100000:3.0:1782229141.122497:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229141.122539:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506048 00000100:00100000:2.0:1782229141.122544:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506048 00000100:00100000:3.0:1782229141.122564:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782229141.122576:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329505920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229141.122578:0:14195:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782229141.122598:0:14195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1782229141.122617:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229141.122627:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329505920:12345-0@lo:400:kworker.0 Request processed in 54us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229141.122640:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782229141.122655:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782229141.122660:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329506048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229141.122684:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329506048:12345-0@lo:400:kworker.0 Request processed in 24us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229141.122688:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782229141.122713:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe6ee3a300 x1868802329506048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229141.122727:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329506048:0@lo:400:kworker.0 00010000:00080000:2.0:1782229141.122971:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe6ee39c00 x1868802329505920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782229141.122983:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329505920:0@lo:400:kworker.0 00000100:00100000:0.0:1782229141.127277:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229141.127554:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329505792 00000100:00100000:2.0:1782229141.127563:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329505792 00000100:00100000:2.0:1782229141.127612:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782229141.127621:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:3308:x1868802329505792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229141.127716:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:3308:x1868802329505792:12345-0@lo:400:kworker.0 Request processed in 83us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229141.127724:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782229141.127728:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329505792:0@lo:400:kworker.0 00000100:00100000:1.0:1782229141.128208:0:3307:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98fd42a37800 x1868802329501440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229141 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229141.128224:0:3307:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782229126/real 1782229126] req@ffff98fd42a36680 x1868802329501568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229141 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229141.128241:0:3307:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98fd42a36680 x1868802329501568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782229141 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782229141.128255:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe50810000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782229141.128274:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782229141.128278:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329501440:0@lo:8:kworker.0 00000100:00080000:1.0:1782229141.128283:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782229141.128292:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782229141.128296:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329501568:0@lo:8:kworker.0 00000100:00080000:2.0:1782229141.128627:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782229141.128633:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782229141.128636:0:8:0:(import.c:65:import_set_state_nolock()) ffff98fe50810000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782229141.128640:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1782229141.128645:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782229141.128650:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98fe50810000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:2.0:1782229141.128682:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe6ee39c00 x1868802329506176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782229141.128820:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329506176:0@lo:8:kworker.0 00000100:00100000:1.0:1782229141.128879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782229141.128973:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782229141.128977:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782229141.128979:0:8:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782229141.128983:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1782229141.128986:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782229141.128990:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98fe77bc9800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:2.0:1782229141.129021:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe6ee39880 x1868802329506304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782229141.129095:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329506304:0@lo:8:kworker.0 00000100:00100000:1.0:1782229141.129125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229141.129486:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506176 00000100:00100000:1.0:1782229141.129494:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506176 00000100:00100000:3.0:1782229141.130243:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506304 00000100:00100000:3.0:1782229141.130249:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506304 00000100:00100000:3.0:1782229141.130269:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782229141.130276:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1868802329506176:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782229141.130305:0:14829:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:3.0:1782229141.130335:0:14829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e648e3 00002000:00100000:3.0:1782229141.130350:0:14829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98fe685d4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782229141.130354:0:14829:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1782229141.130371:0:14829:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782229141.130743:0:14829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782229141.130767:0:14829:0:(import.c:65:import_set_state_nolock()) ffff98fe685d5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782229141.130833:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1868802329506176:12345-0@lo:8:kworker.0 Request processed in 554us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229141.130842:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782229141.130861:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782229141.130866:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1868802329506304:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1782229141.130889:0:14829:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782229141.130916:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1868802329506304:12345-0@lo:8:kworker.0 Request processed in 49us (1791us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782229141.130922:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782229141.132896:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782229141.132906:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782229141.132912:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329506304:0@lo:8:kworker.0 00010000:00080000:0.0:1782229141.132929:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe6ee39c00 x1868802329506176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782229161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229141.132941:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782229141.132948:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782229141.132957:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782229141.132964:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782229141.132967:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe50810000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782229141.132987:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782229141.132994:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329506176:0@lo:8:kworker.0 00000004:00080000:3.0:1782229141.135577:0:14216:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1782229141.135603:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329506432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782229141.135610:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14216:1868802329506560:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782229141.141914:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1782229141.142027:0:14215:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782229141.142350:0:14215:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 454138918653ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782229141.142539:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506432 00000100:00100000:0.0:1782229141.142548:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506432 00000100:00100000:0.0:1782229141.142607:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782229141.142616:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329506432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782229141.142648:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229141.142708:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1868802329506432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229141.142715:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782229141.142772:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fe77c08a80 x1868802329506432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229141.142792:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329506432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782229141.143627:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229141.145507:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229141.145557:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666540 going to sleep for 11 seconds 00000100:00100000:3.0:1782229141.145594:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506560 00000100:00100000:3.0:1782229141.145601:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506560 00000100:00100000:3.0:1782229141.145643:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782229141.145650:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14216:x1868802329506560:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1782229141.152901:0:14829:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1782229141.152912:0:14829:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1782229141.152918:0:14829:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1782229141.186522:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782229141.186544:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.186561:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=454s v=(0 0) 00010000:00010000:3.0:1782229141.186565:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229141.186571:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.186588:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.186612:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.186619:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.186648:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782229141.187088:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782229141.187094:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187104:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=454s v=(0 0) 00010000:00010000:3.0:1782229141.187107:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229141.187111:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187119:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187126:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187132:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187162:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782229141.187177:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782229141.187182:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187190:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229141.187196:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187205:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187222:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187229:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a596a0f/0x8e1c8a3488e648ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187245:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229141.187248:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187253:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229141.187257:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187275:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187284:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187290:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b80c66/0x8e1c8a3488e648f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187302:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.187303:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.187305:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782229141.187742:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782229141.187749:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187758:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=454s v=(0 0) 00010000:00010000:3.0:1782229141.187761:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229141.187765:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187775:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187784:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187803:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187819:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229141.187828:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229141.187831:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187838:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916e00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229141.187841:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187848:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187859:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187865:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc248f19/0x8e1c8a3488e648f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.187877:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.187879:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.187880:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782229141.188283:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782229141.188297:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.188306:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=454s v=(0 0) 00010000:00010000:3.0:1782229141.188308:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229141.188312:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.188320:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.188330:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.188337:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.188352:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229141.188364:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229141.188367:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.188374:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.189051:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.189291:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.189298:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189309:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.189318:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.189324:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189336:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189345:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189351:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189374:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.189572:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.189734:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.189742:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.189752:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.189756:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.189766:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.189783:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.189791:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007682d6d9/0x8e1c8a3488e64906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.189812:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.189821:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.189823:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.189828:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.189831:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.189846:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.189853:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189860:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.189863:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.189867:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189875:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189883:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189896:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.189917:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.189990:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.189995:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190003:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.190007:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190017:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190030:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190037:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc56010c/0x8e1c8a3488e6490d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190052:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.190054:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.190057:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.190315:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.190320:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190328:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.190330:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.190334:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190343:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190351:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190357:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190377:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.190743:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.190750:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190769:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.190773:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190782:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190795:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190801:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004534f065/0x8e1c8a3488e64914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.190818:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.190820:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.190822:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.190832:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.190840:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190853:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.190856:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.190859:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190868:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190875:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190881:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.190902:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.191098:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.191103:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191111:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.191114:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191122:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191140:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191149:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f842dbf4/0x8e1c8a3488e6491b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191166:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.191168:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.191170:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.191287:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.191292:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191299:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.191302:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.191305:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191313:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191331:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191337:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191357:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.191454:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.191459:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191468:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.191472:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191481:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191493:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191500:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64922 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191548:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.191551:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.191553:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.191783:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.191789:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191797:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.191800:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.191804:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191813:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191821:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191828:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.191860:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.191883:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.191889:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191896:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015c00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.191900:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191909:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191922:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191929:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d285a09/0x8e1c8a3488e64929 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.191945:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.191947:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.191949:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.192307:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.192313:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.192322:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.192325:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.192328:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.192336:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.192343:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.192350:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.192372:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.192473:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.192479:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.192500:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.192504:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.192512:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.192541:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.192549:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038048da7/0x8e1c8a3488e64930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.192563:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.192565:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.192566:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.199146:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.199162:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.199179:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.199193:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.199199:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.199214:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.199225:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.199233:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.200086:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229141.201874:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.201900:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.201934:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.201943:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e648ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.201972:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229141.201978:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.201985:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d014400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229141.201989:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.201995:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.202005:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.202012:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b04000ee/0x8e1c8a3488e64937 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.202026:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.202028:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.202933:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.202943:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.202957:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.202961:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.202966:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.202978:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.202987:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.203000:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.204150:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229141.205874:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229141.206426:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229141.206446:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206458:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229141.206463:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206474:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206495:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206503:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c36588a/0x8e1c8a3488e6493e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206537:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.206539:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.206542:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.206765:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.206773:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.206785:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.206790:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.206796:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.206809:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.206817:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.206825:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.206850:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229141.206946:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229141.206951:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206959:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d014600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229141.206963:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206982:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.206993:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.207001:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.207014:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.207016:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.207018:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.209809:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.209823:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209844:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.209848:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.209854:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209869:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209878:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209885:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209905:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229141.209929:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229141.209935:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209943:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d014200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229141.209955:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209965:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.209993:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.210000:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4b32463/0x8e1c8a3488e6494c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.210038:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229141.210040:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229141.210043:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229141.210050:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.210968:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.210975:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.210986:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.210990:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.210993:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.211003:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.211985:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.211996:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.212149:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229141.212188:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229141.212197:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.212209:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229141.212214:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.212239:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.212256:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.212264:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000582f7e68/0x8e1c8a3488e64953 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.212285:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.212288:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229141.212290:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.212973:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.212982:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.212994:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.212997:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.213003:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.213242:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.213253:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.213259:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.213283:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782229141.213308:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.213314:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.213322:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.213327:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.213334:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.213349:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.213357:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b36bf6c/0x8e1c8a3488e6495a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.213373:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.213374:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.213376:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.214967:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.214977:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.214989:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.214999:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.215005:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217279:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217293:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217301:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217318:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229141.217331:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229141.217337:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217346:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015e00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229141.217350:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217358:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217374:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217396:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069de0114/0x8e1c8a3488e64961 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217418:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229141.217420:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229141.217422:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782229141.217979:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782229141.217987:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.217999:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=454s v=(0 0) 00010000:00010000:1.0:1782229141.218003:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229141.221879:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.221912:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.221925:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229141.221933:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.221993:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782229141.223308:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782229141.223319:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223333:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=454s v=(0 0) 00010000:00010000:0.0:1782229141.223337:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229141.223342:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223353:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223363:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223370:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223389:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782229141.223402:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782229141.223408:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223415:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d014a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.223420:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223475:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223493:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223500:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ad53790/0x8e1c8a3488e64968 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223519:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.223532:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223539:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.223542:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223549:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223558:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223565:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7da016f/0x8e1c8a3488e6496f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.223587:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.223589:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.223591:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782229141.224055:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782229141.224060:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224070:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=454s v=(0 0) 00010000:00010000:0.0:1782229141.224073:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229141.224077:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224087:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224095:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224103:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224119:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782229141.224545:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782229141.224551:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224572:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=454s v=(0 0) 00010000:00010000:0.0:1782229141.224575:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229141.224579:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224587:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224595:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224602:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224619:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782229141.224631:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782229141.224636:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224643:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.224647:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224656:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224678:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224685:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbdebc87/0x8e1c8a3488e64976 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224698:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.224701:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224708:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.224711:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224718:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224726:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224732:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e67fcd5c/0x8e1c8a3488e6497d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.224742:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.224743:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.224749:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782229141.225133:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782229141.225139:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225147:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=454s v=(0 0) 00010000:00010000:0.0:1782229141.225150:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782229141.225154:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225164:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225172:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225179:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225192:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782229141.225200:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.225203:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225211:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23c00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.225214:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225233:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225244:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225251:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa629a90/0x8e1c8a3488e64984 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.225263:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.225265:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.225266:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.225946:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229141.227982:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229141.236319:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229141.236335:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.236352:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=454s v=(0 0) 00010000:00010000:2.0:1782229141.236357:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229141.236364:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.236377:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.236389:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.236405:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.236420:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782229141.236915:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.236923:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.236933:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.236938:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.236947:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.236965:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.236984:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a174acd7/0x8e1c8a3488e6498b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.237003:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.237005:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.237007:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229141.237327:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229141.237334:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237344:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=454s v=(0 0) 00010000:00010000:2.0:1782229141.237347:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229141.237351:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237360:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237369:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237376:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237396:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782229141.237462:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782229141.237469:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.237477:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229141.237482:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.237491:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.237502:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229141.237515:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d641e4b/0x8e1c8a3488e64992 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229141.237862:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229141.237868:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237881:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=454s v=(0 0) 00010000:00010000:2.0:1782229141.237884:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229141.237888:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237896:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237904:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237910:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.237931:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782229141.238215:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.238221:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238230:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.238234:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238242:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238254:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238260:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce150de7/0x8e1c8a3488e64999 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238277:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.238279:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.238282:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229141.238315:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229141.238322:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238330:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=454s v=(0 0) 00010000:00010000:2.0:1782229141.238333:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229141.238337:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238347:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238368:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238376:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238394:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782229141.238476:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.238482:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238490:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dccc00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.238494:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238502:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238514:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238533:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000909c2055/0x8e1c8a3488e649a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.238551:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.238553:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.238555:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229141.238821:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229141.238828:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238836:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=454s v=(0 0) 00010000:00010000:2.0:1782229141.238839:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229141.238843:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238851:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238858:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238865:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229141.238894:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1782229141.239068:0:14829:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1782229141.239163:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14216:x1868802329506560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93508us (93655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229141.239176:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1782229141.239220:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229141.239226:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229141.239231:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14216:1868802329506560:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1782229141.239238:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229141.239242:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782229141.239248:0:14216:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00010000:00010000:0.0:1782229141.239265:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.239277:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229141.239285:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f0248f/0x8e1c8a3488e649a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229141.239293:0:14216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14216:1868802329506688:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1782229141.239302:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.239305:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229141.239307:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229141.239328:0:14216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229141.239374:0:14216:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe505bf180 going to sleep for 11 seconds 00000100:00100000:2.0:1782229141.239390:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506688 00000100:00100000:2.0:1782229141.239396:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506688 00000100:00100000:2.0:1782229141.239463:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782229141.239471:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14216:x1868802329506688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1782229141.239506:0:14830:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1782229141.240320:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782229141.248131:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1782229141.257042:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14216:x1868802329506688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17560us (17702us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782229141.257056:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782229141.258320:0:14216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14216:1868802329506688:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1782229141.258338:0:14216:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1782229142.012817:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229143.044967:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782229143.962264:0:15497:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782229143.962268:0:15497:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1782229143.962377:0:15497:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff98fd42be5800 00000020:01000004:3.0:1782229143.962394:0:15497:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1782229143.962408:0:15497:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1782229143.962421:0:15497:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98fe74e3cd40) 00000020:00000080:3.0:1782229143.962483:0:15497:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782229143.977201:0:15497:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782229143.977579:0:15497:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782229143.978367:0:15497:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782229143.979667:0:15497:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1782229143.979991:0:15497:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782229143.980383:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 459: rc = 0 00100000:10000000:3.0:1782229143.980576:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 459: rc = 0 00100000:10000000:3.0:1782229143.980743:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 459: rc = 0 00100000:10000000:3.0:1782229143.982240:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 561: rc = 0 00100000:10000000:3.0:1782229143.982602:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 561: rc = 0 00100000:10000000:3.0:1782229143.983149:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 561: rc = 0 00100000:10000000:3.0:1782229143.983390:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 561: rc = 0 00100000:10000000:3.0:1782229143.983775:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 561: rc = 0 00100000:10000000:3.0:1782229143.984021:0:15497:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 561: rc = 0 00000020:00000080:3.0:1782229143.985563:0:15497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782229143.985582:0:15497:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782229143.985593:0:15497:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e1c8a3488e649b5 00000020:01000004:3.0:1782229143.985602:0:15497:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1782229143.985623:0:15497:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782229143.985627:0:15497:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782229143.985633:0:15497:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782229143.985656:0:15497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1782229143.985660:0:15497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782229143.993973:0:15497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782229143.994010:0:15497:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.122@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1782229143.994015:0:15497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782229143.994017:0:15497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782229143.994018:0:15497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782229143.994019:0:15497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782229143.994020:0:15497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782229143.994022:0:15497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782229143.994023:0:15497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782229143.994025:0:15497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782229143.994027:0:15497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782229143.994030:0:15497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1782229143.994033:0:15497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782229143.994035:0:15497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782229143.994036:0:15497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782229143.994037:0:15497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782229143.994038:0:15497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782229143.994040:0:15497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782229143.994040:0:15497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782229143.994041:0:15497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782229143.994042:0:15497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782229143.994072:0:15497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782229143.994098:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329506816:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782229143.994191:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229143.994310:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782229143.994394:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506816 00000100:00100000:1.0:1782229143.994407:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506816 00000100:00100000:1.0:1782229143.994610:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782229143.994619:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:15497:x1868802329506816:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782229143.994647:0:14187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782229143.994650:0:14187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1782229143.994654:0:14187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782229144.002976:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:15497:x1868802329506816:12345-0@lo:253:mount.lustre.0 Request processed in 8348us (8775us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229144.002992:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782229144.003099:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329506816:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782229144.003114:0:15497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782229144.003118:0:15497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782229144.003119:0:15497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782229144.003121:0:15497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782229144.003122:0:15497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782229144.003123:0:15497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782229144.003124:0:15497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782229144.003125:0:15497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782229144.003127:0:15497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782229144.003128:0:15497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782229144.003151:0:15497:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fd42be5800 from lustre-OST0001 10000000:01000000:0.0:1782229144.003174:0:15497:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782229144.003177:0:15497:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782229144.003184:0:15497:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98fe7fff8000 local copy 00010000:00010000:0.0:1782229144.003209:0:15497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229144.003419:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329506944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229144.003549:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.003629:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c49d540 going to sleep for 11 seconds 00000100:00100000:2.0:1782229144.003784:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329506944 00000100:00100000:2.0:1782229144.003791:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329506944 00000100:00100000:2.0:1782229144.003870:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782229144.003887:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:15497:x1868802329506944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229144.004052:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:15497:x1868802329506944:12345-0@lo:501:mount.lustre.0 Request processed in 167us (502us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782229144.004060:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782229144.004124:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329506944:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782229144.004140:0:15497:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782229144.004280:0:15497:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782229144.004287:0:15497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.004297:0:15497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917400/0x8e1c8a3488e6475b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64762 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782229144.004318:0:15497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fd42be5800 10000000:01000000:0.0:1782229144.004324:0:15497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782229144.004329:0:15497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782229144.004332:0:15497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782229144.004337:0:15497:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1782229144.004340:0:15497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782229144.004360:0:15497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e649bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.004369:0:15497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e649bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.004379:0:15497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e649bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229144.004403:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782229144.004460:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.004618:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c49d540 going to sleep for 11 seconds 00000100:00100000:1.0:1782229144.004746:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507072 00000100:00100000:1.0:1782229144.004752:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507072 00000100:00100000:1.0:1782229144.004776:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782229144.004783:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:15497:x1868802329507072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782229144.004792:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229144.004806:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe7d014e00/0x8e1c8a3488e649c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e649bc expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229144.004827:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe7d014e00/0x8e1c8a3488e649c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e649bc expref: 17 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229144.004838:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe7d014e00/0x8e1c8a3488e649c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e649bc expref: 17 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229144.004847:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe7d014e00, rc 0) 00000100:00100000:1.0:1782229144.004888:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507072:12345-0@lo:101:mount.lustre.0 Request processed in 105us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229144.004894:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782229144.004970:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782229144.004983:0:15497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e649bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649c3 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.004993:0:15497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e649bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e649c3 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782229144.005613:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1782229144.006531:0:15497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782229144.008070:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1782229144.008142:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1782229144.008178:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1782229144.008231:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1782229144.008272:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1782229144.008308:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1782229144.008422:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1782229144.010787:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1782229144.011117:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229144.011181:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.011225:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c49d180 going to sleep for 11 seconds 00000100:00100000:0.0:1782229144.011659:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507200 00000100:00100000:0.0:1782229144.011666:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507200 00000100:00100000:0.0:1782229144.011808:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782229144.011817:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229144.012265:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507200:12345-0@lo:501:mount.lustre.0 Request processed in 448us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.012273:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782229144.012352:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782229144.012391:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782229144.012458:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229144.014958:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507328 00000100:00100000:2.0:1782229144.014971:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507328 00000100:00100000:2.0:1782229144.015017:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782229144.015026:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782229144.015382:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507328:12345-0@lo:503:mount.lustre.0 Request processed in 357us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229144.015390:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782229144.015942:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782229144.015968:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507328:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782229144.017372:0:15497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782229144.017504:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782229144.017580:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229144.017622:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782229144.018696:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507456 00000100:00100000:2.0:1782229144.018706:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507456 00000100:00100000:2.0:1782229144.018761:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782229144.018770:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782229144.019052:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507456:12345-0@lo:502:mount.lustre.0 Request processed in 282us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229144.019060:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782229144.019400:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782229144.019736:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1782229144.019791:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1782229144.019824:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1782229144.019871:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1782229144.019903:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1782229144.019932:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1782229144.019976:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1782229144.020012:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1782229144.020057:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1782229144.020094:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782229144.020144:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229144.020187:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe44666b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782229144.020319:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507584 00000100:00100000:0.0:1782229144.020325:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507584 00000100:00100000:0.0:1782229144.020365:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782229144.020374:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782229144.020582:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507584:12345-0@lo:502:mount.lustre.0 Request processed in 209us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.020590:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782229144.020804:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782229144.020872:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1782229144.020882:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1782229144.021904:0:15498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782229144.021913:0:15498:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1782229144.021920:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782229144.021922:0:15498:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1782229144.021927:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782229144.021942:0:15498:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98fe6f6ccd40) 00000020:00000080:2.0:1782229144.021962:0:15498:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782229144.021969:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782229144.022030:0:15498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fd42be5800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1782229144.022038:0:15498:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782229144.022055:0:15498:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8e1c8a3488e649d1 00010000:00010000:2.0:1782229144.026244:0:15498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1782229144.027274:0:15498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1782229144.029805:0:15498:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1782229144.031950:0:15498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782229144.031962:0:15498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229144.031976:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229144.031978:0:15498:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782229144.031983:0:15498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782229144.031987:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229144.031988:0:15498:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782229144.031991:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782229144.031993:0:15498:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782229144.031995:0:15498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229144.031997:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229144.031998:0:15498:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782229144.032000:0:15498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782229144.032002:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229144.032003:0:15498:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782229144.032006:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782229144.032063:0:15498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782229144.032067:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782229144.032068:0:15498:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782229144.032071:0:15498:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1782229144.038985:0:15497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1782229144.039032:0:15497:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782229144.039088:0:15497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e649bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649c3 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.039107:0:15497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe59e22600/0x8e1c8a3488e649bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649c3 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782229144.039115:0:15497:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fd42be5800 from 1 10000000:01000000:3.0:1782229144.039117:0:15497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782229144.039155:0:15497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.039163:0:15497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.039173:0:15497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229144.039196:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782229144.039262:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229144.039310:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229144.041720:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507712 00000100:00100000:0.0:1782229144.041733:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507712 00000100:00100000:0.0:1782229144.041798:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782229144.041809:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:15497:x1868802329507712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782229144.041824:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229144.041840:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e649d8 expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.041868:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 18 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.041878:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 18 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.041887:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23000, rc 0) 00000100:00100000:0.0:1782229144.041983:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329507712:12345-0@lo:101:mount.lustre.0 Request processed in 176us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.042008:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782229144.042085:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782229144.042104:0:15497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229144.042114:0:15497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782229144.044248:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1782229144.048067:0:15497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782229144.048694:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1782229144.049373:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1782229144.049672:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1782229144.049682:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1782229144.049876:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229144.049940:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229144.049984:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe685f63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229144.050180:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507840 00000100:00100000:0.0:1782229144.050189:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507840 00000100:00100000:0.0:1782229144.050241:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782229144.050250:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329507840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229144.050500:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329507840:12345-0@lo:501:mount.lustre.0 Request processed in 250us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.050507:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782229144.050839:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782229144.050873:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782229144.050914:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229144.050945:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe685f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782229144.051220:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329507968 00000100:00100000:3.0:1782229144.051227:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329507968 00000100:00100000:3.0:1782229144.051268:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782229144.051276:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329507968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782229144.051568:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329507968:12345-0@lo:503:mount.lustre.0 Request processed in 293us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229144.051576:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782229144.051824:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329507968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782229144.053094:0:15497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782229144.054242:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782229144.054328:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229144.054392:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe438983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782229144.054534:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508096 00000100:00100000:1.0:1782229144.054542:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508096 00000100:00100000:1.0:1782229144.054597:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782229144.054606:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329508096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229144.056008:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329508096:12345-0@lo:502:mount.lustre.0 Request processed in 1399us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229144.056019:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782229144.056197:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782229144.056539:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1782229144.056619:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1782229144.056693:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1782229144.056750:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1782229144.056788:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1782229144.056842:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1782229144.056881:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1782229144.056911:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1782229144.056946:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782229144.057000:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229144.057038:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe446663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229144.057176:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508224 00000100:00100000:0.0:1782229144.057183:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508224 00000100:00100000:0.0:1782229144.057276:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782229144.057286:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329508224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782229144.057499:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329508224:12345-0@lo:502:mount.lustre.0 Request processed in 215us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.057507:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782229144.057658:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782229144.057748:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1782229144.057759:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1782229144.060387:0:15502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782229144.060399:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782229144.060401:0:15502:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782229144.060408:0:15502:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fd42be5800 00000020:00000080:3.0:1782229144.060410:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782229144.060416:0:15502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782229144.060418:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782229144.060420:0:15502:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782229144.060422:0:15502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782229144.060424:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782229144.060425:0:15502:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782229144.060443:0:15502:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fd42be5800 00000020:00000080:3.0:1782229144.060445:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782229144.060515:0:15502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782229144.060518:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782229144.060519:0:15502:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782229144.060522:0:15502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782229144.060524:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782229144.060526:0:15502:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782229144.060530:0:15502:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98fd42be5800 00000020:00000080:3.0:1782229144.060539:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782229144.060589:0:15502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782229144.060592:0:15502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782229144.060594:0:15502:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782229144.060597:0:15502:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00010000:00010000:2.0:1782229144.060780:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1782229144.063004:0:15497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1782229144.063040:0:15497:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782229144.063069:0:15497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.063083:0:15497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782229144.063135:0:15497:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782229144.063138:0:15497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fd42be5800 10000000:01000000:0.0:1782229144.063142:0:15497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fd42be5800 10000000:01000000:0.0:1782229144.063146:0:15497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782229144.063157:0:15497:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff98fd42be5800 from 1 10000000:01000000:0.0:1782229144.063159:0:15497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782229144.063195:0:15497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e649e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.063203:0:15497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e649e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.063214:0:15497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e649e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229144.063240:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782229144.063308:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229144.063359:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508352 00000100:00100000:0.0:1782229144.063364:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c49d300 going to sleep for 11 seconds 00000100:00100000:3.0:1782229144.063367:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508352 00000100:00100000:3.0:1782229144.063425:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782229144.063461:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329508352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782229144.063490:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229144.063504:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e649ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e649e6 expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.063531:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e649ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e649e6 expref: 19 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.063541:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916e00/0x8e1c8a3488e649ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e649e6 expref: 19 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.063550:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916e00, rc 0) 00000100:00100000:3.0:1782229144.063590:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508352:12345-0@lo:101:mount.lustre.0 Request processed in 132us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229144.063597:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782229144.065815:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782229144.065839:0:15497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e649e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649ed expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.065852:0:15497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e649e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e649ed expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782229144.066575:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1782229144.070641:0:15497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782229144.071078:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1782229144.071140:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1782229144.071174:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1782229144.071217:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1782229144.071253:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1782229144.071302:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1782229144.071340:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1782229144.071385:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1782229144.071459:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1782229144.072917:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1782229144.072978:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1782229144.073064:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1782229144.073098:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1782229144.073130:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1782229144.073185:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1782229144.073224:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1782229144.073272:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1782229144.073369:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1782229144.073415:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1782229144.073501:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1782229144.073595:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1782229144.075790:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1782229144.075899:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1782229144.076007:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1782229144.076055:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1782229144.076090:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1782229144.076142:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1782229144.076182:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1782229144.076218:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1782229144.076280:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1782229144.076330:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1782229144.076369:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1782229144.076411:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1782229144.076518:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1782229144.076558:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1782229144.076608:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1782229144.076643:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1782229144.079899:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1782229144.079919:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1782229144.080020:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229144.080094:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.080136:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508480 00000100:00100000:0.0:1782229144.080142:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508480 00000100:00100000:0.0:1782229144.080194:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782229144.080203:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229144.080413:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508480:12345-0@lo:501:mount.lustre.0 Request processed in 212us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.080421:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782229144.083552:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c49d300 going to sleep for 11 seconds 00000100:00100000:0.0:1782229144.083599:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782229144.083660:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782229144.085845:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.085890:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6c49d300 going to sleep for 11 seconds 00000100:00100000:2.0:1782229144.086902:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508608 00000100:00100000:2.0:1782229144.086912:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508608 00000100:00100000:2.0:1782229144.086970:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782229144.086980:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782229144.088623:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508608:12345-0@lo:503:mount.lustre.0 Request processed in 1638us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229144.088635:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782229144.088807:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782229144.089332:0:15497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782229144.089407:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782229144.089978:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.090015:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42bdf300 going to sleep for 11 seconds 00000100:00100000:2.0:1782229144.091741:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508736 00000100:00100000:2.0:1782229144.091751:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508736 00000100:00100000:2.0:1782229144.091805:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782229144.091814:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782229144.092162:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508736:12345-0@lo:502:mount.lustre.0 Request processed in 347us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229144.092170:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782229144.092283:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782229144.092578:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782229144.092627:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1782229144.092658:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1782229144.092701:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1782229144.092736:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1782229144.092792:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782229144.092820:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782229144.092853:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782229144.092906:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782229144.092944:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782229144.092984:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782229144.093034:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782229144.093072:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782229144.093110:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782229144.093160:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782229144.093208:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782229144.093266:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782229144.093314:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782229144.093353:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782229144.093389:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782229144.093462:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782229144.093514:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782229144.093546:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1782229144.093589:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1782229144.093626:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1782229144.093660:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1782229144.093709:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1782229144.093746:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1782229144.093780:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1782229144.093827:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1782229144.093862:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1782229144.093898:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1782229144.093947:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1782229144.093996:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1782229144.094034:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1782229144.094085:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1782229144.094124:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1782229144.094161:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1782229144.094225:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1782229144.094260:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1782229144.094305:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782229144.094371:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229144.094412:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe42bdf300 going to sleep for 11 seconds 00000100:00100000:2.0:1782229144.095091:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508864 00000100:00100000:2.0:1782229144.095100:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508864 00000100:00100000:2.0:1782229144.095146:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782229144.095155:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782229144.095394:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329508864:12345-0@lo:502:mount.lustre.0 Request processed in 239us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229144.095402:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782229144.098599:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329508864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782229144.098741:0:15497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1782229144.098763:0:15497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1782229144.100452:0:15507:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1782229144.100479:0:15507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98fe6f6c99c0) 00000020:00000080:2.0:1782229144.100500:0:15507:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1782229144.100645:0:15507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fd42be5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782229144.100649:0:15507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fd42be5800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782229144.100657:0:15507:0:(obd_mount.c:701:lustre_put_lsi()) put ffff98fd42be5800 3 00010000:00080000:2.0:1782229144.100692:0:15507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fe6dd22000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.122@tcp at head 00010000:00010000:2.0:1782229144.106615:0:15507:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1782229144.106718:0:15507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1782229144.106754:0:15507:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782229144.106774:0:15507:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8e1c8a3488e649fb 00000100:00080000:2.0:1782229144.106785:0:15507:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782229144.106791:0:15507:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98fe6dd22000 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:2.0:1782229144.106824:0:15507:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe6ee3b100 x1868802329508992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782229144.106857:0:15507:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782229144.106908:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782229144.106913:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782229144.106915:0:37:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782229144.106920:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:2.0:1782229144.106924:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1782229144.106931:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98fe77bc9800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782229144.106931:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1868802329508992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782229144.106947:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe6ee38700 x1868802329509248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782229144.106999:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329509376:0@lo:400:kworker.0 00000100:00100000:0.0:1782229144.107014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.107076:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329509248:0@lo:8:kworker.0 00000100:00100000:0.0:1782229144.107104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.107146:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329509120:0@lo:400:kworker.0 00000100:00100000:0.0:1782229144.107172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.107211:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329509504:0@lo:400:kworker.0 00000100:00100000:0.0:1782229144.107235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.107277:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329509248 00000100:00100000:0.0:1782229144.107285:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329509248 00000100:00100000:0.0:1782229144.107312:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329509120 00000100:00100000:0.0:1782229144.107316:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329509120 00000100:00100000:0.0:1782229144.107352:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782229144.107362:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329509120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229144.107368:0:14827:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782229144.107380:0:14827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1782229144.107451:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329509120:12345-0@lo:400:kworker.0 Request processed in 70us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.107458:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782229144.107488:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782229144.107492:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1868802329509248:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1782229144.107539:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1868802329509248:12345-0@lo:8:kworker.0 Request processed in 45us (434us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782229144.107546:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782229144.107565:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329508992 00000100:00100000:0.0:1782229144.107569:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329508992 00000100:00100000:0.0:1782229144.107584:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329509504 00000100:00100000:0.0:1782229144.107586:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329509504 00000100:00100000:0.0:1782229144.107611:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782229144.107618:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329509504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229144.107655:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329509504:12345-0@lo:400:kworker.0 Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.107662:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782229144.107694:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782229144.107699:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1868802329508992:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782229144.107714:0:14195:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:0.0:1782229144.107762:0:14195:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8e1c8a3488e64a02 00000004:00100000:0.0:1782229144.107778:0:14195:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782229144.107812:0:14195:0:(import.c:65:import_set_state_nolock()) ffff98fe6f6a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782229144.107852:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1868802329508992:12345-0@lo:38:llog_process_th.0 Request processed in 151us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.107859:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1782229144.107881:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782229144.107887:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229144.107900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782229144.107950:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe6ee3a680 x1868802329509504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229144.107963:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329509504:0@lo:400:kworker.0 00000100:00100000:0.0:1782229144.108154:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782229144.108160:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782229144.108165:0:3307:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782229144.108168:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329509248:0@lo:8:kworker.0 00010000:00080000:0.0:1782229144.108179:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe6ee3b100 x1868802329508992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782229154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229144.108186:0:3307:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782229144.108190:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1782229144.108198:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782229144.108202:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782229144.108205:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe6dd22000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782229144.108209:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1868802329508992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782229144.108230:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329509376 00000100:00100000:0.0:1782229144.108241:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329509376 00000100:00100000:0.0:1782229144.108265:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782229144.108271:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329509376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229144.108306:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329509376:12345-0@lo:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.108312:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782229144.108340:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe6ee3aa00 x1868802329509376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782229144.108349:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329509376:0@lo:400:kworker.0 00000100:00100000:2.0:1782229144.108410:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329509120:0@lo:400:kworker.0 00000040:00080000:2.0:1782229144.117293:0:15507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1782229144.117488:0:15497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1782229144.117523:0:15497:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782229144.117546:0:15497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e649e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649ed expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229144.117557:0:15497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe59e23600/0x8e1c8a3488e649e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e649ed expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782229144.117615:0:15497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782229144.117617:0:15497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782229144.117619:0:15497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782229144.117620:0:15497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782229144.117622:0:15497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782229144.117623:0:15497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782229144.117625:0:15497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782229144.117627:0:15497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782229144.117629:0:15497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782229144.117632:0:15497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1782229144.117634:0:15497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782229144.117635:0:15497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782229144.117636:0:15497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782229144.117637:0:15497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782229144.117644:0:15497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782229144.117645:0:15497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782229144.117646:0:15497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782229144.117647:0:15497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782229144.117649:0:15497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782229144.117817:0:15497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782229144.117837:0:15497:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329509632:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782229144.117908:0:15497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229144.117951:0:15497:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe43954840 going to sleep for 11 seconds 00000100:00100000:2.0:1782229144.118821:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329509632 00000100:00100000:2.0:1782229144.118831:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329509632 00000100:00100000:2.0:1782229144.118917:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782229144.118928:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:15497:x1868802329509632:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782229144.118959:0:14188:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782229144.118976:0:14188:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782229144.161930:0:14188:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782229144.161947:0:14188:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1782229144.162008:0:14209:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782229144.162013:0:14209:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782229144.162035:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229144.162054:0:14209:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 19 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229144.162063:0:14209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229144.162100:0:14209:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 19 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229144.162115:0:14209:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 19 pid: 14188 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229144.162129:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14209:1868802329509760:0@lo:104: 00000100:00100000:1.0:1782229144.162193:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229144.162238:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe69154180 going to sleep for 11 seconds 00000100:00100000:2.0:1782229144.164042:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329509760 00000100:00100000:2.0:1782229144.164052:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329509760 00000100:00100000:2.0:1782229144.164117:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782229144.164127:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14209:x1868802329509760:12345-0@lo:104: 00010000:00010000:2.0:1782229144.164143:0:14176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229144.164238:0:14176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782229144.164244:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:14209:x1868802329509760:12345-0@lo:104: Request processed in 120us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229144.164251:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1782229144.164277:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229144.164282:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229144.164290:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421a00 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:2.0:1782229144.164294:0:14182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229144.164301:0:14182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782229144.164307:0:14182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782229144.164325:0:14182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782229144.164358:0:14182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229144.164365:0:14182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782229144.164389:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229144.164395:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe74421a00/0x8e1c8a3488e648d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e648dc expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229144.164411:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14209:1868802329509760:0@lo:104: 00010000:00010000:2.0:1782229144.164411:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229144.164414:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229144.164417:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229144.164476:0:14209:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229144.164492:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3311:1868802329509888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229144.164531:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229144.164630:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329509888 00000100:00100000:3.0:1782229144.164634:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329509888 00010000:00010000:3.0:1782229144.164655:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 20 pid: 14188 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229144.164696:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782229144.164704:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+20:3311:x1868802329509888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782229144.164715:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229144.164721:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 20 pid: 14188 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164734:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 20 pid: 14188 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164747:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe74420400/0x8e1c8a3488e648dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e648d5 expref: 20 pid: 14188 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164761:0:14180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164768:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782229144.164781:0:14180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002769259s 00010000:00010000:3.0:1782229144.164785:0:14180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164792:0:14180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164798:0:14180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164805:0:14180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164816:0:14180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229144.164820:0:14180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164828:0:14180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164842:0:14180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164853:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229144.164889:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3311:x1868802329509888:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229144.164896:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782229144.164920:0:14209:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164927:0:14209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229144.164934:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe7d015200/0x8e1c8a3488e64a09 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229144.165013:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3311:1868802329509888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782229144.174967:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:15497:x1868802329509632:12345-0@lo:253:mount.lustre.0 Request processed in 56033us (57050us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229144.174981:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782229144.175061:0:15497:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:15497:1868802329509632:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782229144.175088:0:15497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782229144.175092:0:15497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782229144.175093:0:15497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782229144.175094:0:15497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782229144.175096:0:15497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782229144.175097:0:15497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782229144.175098:0:15497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782229144.175100:0:15497:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782229144.175102:0:15497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782229144.175103:0:15497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782229144.175120:0:15497:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782229144.179739:0:15497:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782229144.179997:0:15497:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782229144.180158:0:15497:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782229144.180306:0:15497:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782229144.180497:0:15497:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782229144.180704:0:15497:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1782229144.183361:0:15497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1782229144.213427:0:15497:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782229144.213488:0:15497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782229144.213524:0:15497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782229144.213580:0:15497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782229144.213594:0:15497:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782229144.213623:0:15497:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1782229145.088707:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229146.107578:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782229146.107623:0:14190:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782229146.107629:0:14190:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff98fd42ec2800 from 8 10000000:01000000:3.0:1782229146.107634:0:14190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782229146.107677:0:14190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e64a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229146.107757:0:14190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e64a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229146.107777:0:14190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e64a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229146.107803:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329510016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782229146.108008:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229146.108506:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6062f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229146.113234:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510016 00000100:00100000:0.0:1782229146.113254:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510016 00000100:00100000:1.0:1782229146.113716:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782229146.113727:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:14190:x1868802329510016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782229146.113744:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229146.113765:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe7d015e00/0x8e1c8a3488e64a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64a10 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229146.113794:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe7d015e00/0x8e1c8a3488e64a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64a10 expref: 19 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229146.113827:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe7d015e00/0x8e1c8a3488e64a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64a10 expref: 19 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229146.113837:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe7d015e00, rc 0) 00000100:00100000:1.0:1782229146.113930:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329510016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (5923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229146.113937:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782229146.115393:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329510016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782229146.115418:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e64a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64a17 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229146.115456:0:14190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e64a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64a17 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229146.115535:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329510144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782229146.115591:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229146.115626:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b180 going to sleep for 11 seconds 00000100:00100000:0.0:1782229146.115644:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510144 00000100:00100000:0.0:1782229146.115649:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510144 00000100:00100000:0.0:1782229146.115687:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782229146.115695:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329510144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782229146.115736:0:14188:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782229146.115752:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782229146.115755:0:14188:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1782229146.115839:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329510144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229146.115847:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782229146.115896:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329510144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782229146.115955:0:14190:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782229146.115963:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e64a10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64a17 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229146.115972:0:14190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe50917200/0x8e1c8a3488e64a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64a17 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229146.246161:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329510272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782229146.247454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229146.247714:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510272 00000100:00100000:0.0:1782229146.247723:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510272 00000100:00100000:0.0:1782229146.247782:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229146.247802:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329510272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782229146.247974:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229146.259174:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1868802329510272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11373us (11714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229146.259190:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782229146.259479:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329510272:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782229146.262130:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1782229146.382777:0:6623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1782229146.382805:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1782229147.142487:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229148.156150:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782229148.540145:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782229149.179552:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782229149.309408:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782229149.309415:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782229149.309420:0:8:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1782229149.311527:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329510528:0@lo:400:kworker.0 00000100:00100000:3.0:1782229149.311589:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782229149.311601:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229149.311607:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329510400:0@lo:400:kworker.0 00000100:00100000:3.0:1782229149.311645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782229149.311724:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98fe77bc9800 using connection 192.168.204.122@tcp/0@lo 00000100:00100000:0.0:1782229149.313518:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510400 00000100:00100000:0.0:1782229149.313541:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510400 00000100:00100000:0.0:1782229149.315112:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782229149.315132:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3308:x1868802329510400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229149.315227:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3308:x1868802329510400:12345-0@lo:400:kworker.0 Request processed in 102us (3580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229149.316893:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fe446ac000 x1868802329510656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782229149.317109:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329510784:0@lo:400:kworker.0 00000100:00100000:2.0:1782229149.317161:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229149.317208:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329511040:0@lo:400:kworker.0 00000100:00100000:0.0:1782229149.317211:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782229149.317260:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510528 00000100:00100000:0.0:1782229149.317267:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510528 00000100:00100000:0.0:1782229149.317308:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229149.317315:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329510528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229149.317321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229149.317344:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782229149.317351:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329510912:0@lo:400:kworker.0 00000100:00100000:0.0:1782229149.317390:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329510528:12345-0@lo:400:kworker.0 Request processed in 75us (5788us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229149.317397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229149.317406:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229149.317466:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329510400:0@lo:400:kworker.0 00000100:00100000:0.0:1782229149.317495:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329510656:0@lo:8:kworker.0 00000100:00100000:0.0:1782229149.317523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229149.319602:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510784 00000100:00100000:2.0:1782229149.319612:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510784 00000100:00100000:3.0:1782229149.319706:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511040 00000100:00100000:3.0:1782229149.319711:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511040 00000100:00100000:3.0:1782229149.319732:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510912 00000100:00100000:3.0:1782229149.319734:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510912 00000100:00100000:3.0:1782229149.319749:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782229149.319756:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329510784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229149.319831:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329510784:12345-0@lo:400:kworker.0 Request processed in 75us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229149.319839:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782229149.319855:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782229149.319861:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329511040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229149.319900:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329511040:12345-0@lo:400:kworker.0 Request processed in 39us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229149.319906:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782229149.319920:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782229149.319926:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329510912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229149.319959:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329510912:12345-0@lo:400:kworker.0 Request processed in 34us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229149.319965:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1782229149.320000:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe446ac380 x1868802329510784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782229149.320014:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329510784:0@lo:400:kworker.0 00010000:00080000:1.0:1782229149.320126:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe446ad180 x1868802329510912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229149.320137:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329510912:0@lo:400:kworker.0 00010000:00080000:1.0:1782229149.320152:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe446ae300 x1868802329511040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782229165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229149.320160:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329511040:0@lo:400:kworker.0 00000100:00080000:0.0:1782229149.320274:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782229149.320280:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229149.320294:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329510656 00000100:00100000:0.0:1782229149.320298:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329510656 00000100:00100000:0.0:1782229149.320373:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782229149.320380:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1868802329510656:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782229149.320405:0:14830:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1782229149.320461:0:14830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8e1c8a3488e64a1e 00002000:00100000:0.0:1782229149.320474:0:14830:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98fe6f6a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782229149.320478:0:14830:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1782229149.320487:0:14830:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782229149.321276:0:14830:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782229149.321304:0:14830:0:(import.c:65:import_set_state_nolock()) ffff98fe6f6a0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782229149.321361:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1868802329510656:12345-0@lo:8:kworker.0 Request processed in 979us (3836us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229149.321382:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782229149.321852:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe446ac000 x1868802329510656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782229174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782229149.321867:0:3307:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782229149.322099:0:3307:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782229149.322107:0:3307:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782229149.322110:0:3307:0:(import.c:65:import_set_state_nolock()) ffff98fe77bc9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782229149.322140:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782229149.322149:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1868802329510656:0@lo:8:kworker.0 00000100:00100000:0.0:1782229149.322323:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782229149.322337:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329510528:0@lo:400:kworker.0 00000004:00080000:1.0:1782229149.322923:0:14217:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1782229149.322929:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329511168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229149.322980:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782229149.323604:0:14218:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1782229149.323628:0:14218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14218:1868802329511296:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782229149.323661:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229149.323680:0:14218:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b000 going to sleep for 11 seconds 00000004:00080000:1.0:1782229149.323854:0:14217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 462320423032ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782229149.324211:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511168 00000100:00100000:0.0:1782229149.324217:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511168 00000100:00080000:1.0:1782229149.324285:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782229149.324288:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782229149.324298:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329511168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782229149.324326:0:14832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229149.324388:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329511168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229149.324397:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782229149.324418:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fe77c09f80 x1868802329511168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782229165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782229149.324536:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329511168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229149.324893:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511296 00000100:00100000:0.0:1782229149.324897:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511296 00000100:00100000:0.0:1782229149.324925:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782229149.324931:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14218:x1868802329511296:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1782229149.353876:0:14829:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1782229149.353891:0:14829:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1782229149.353898:0:14829:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1782229149.372553:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.372577:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.372594:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.372599:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.372606:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.372623:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.372634:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.372642:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.372724:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782229149.373138:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.373145:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373159:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.373163:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.373167:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373176:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373185:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373192:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373204:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1782229149.373588:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.373594:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373603:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.373606:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.373611:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373619:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373637:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.373645:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373745:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782229149.373752:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373772:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcde00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.373777:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373786:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373806:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373814:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373833:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229149.373836:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373849:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.373852:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373858:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373869:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373887:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.373900:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.373902:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.373904:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.373912:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.375917:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229149.376053:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229149.376061:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.376071:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.376076:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.376099:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.376118:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.376126:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.376151:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.376153:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.376156:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.378157:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.378168:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.378183:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.378187:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.378193:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.378205:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.378215:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.378223:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.379154:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782229149.379788:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.379796:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.379808:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.379812:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.379817:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.379828:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.379838:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.379846:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380329:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782229149.380337:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380346:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcce00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.380352:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380361:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380394:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380621:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189502b7/0x8e1c8a3488e64a3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380643:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.380701:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380709:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.380713:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380728:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380739:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.380747:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.380749:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.380751:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.380828:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.380834:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b4b8169/0x8e1c8a3488e64a41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.381426:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.381729:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.381746:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.381749:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.381755:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.381767:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.381777:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.381785:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.381899:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.381905:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.381913:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.381917:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.381926:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.381938:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.381947:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.381949:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.381951:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.382018:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.382023:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f0248f/0x8e1c8a3488e64a48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.382802:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.382808:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.382818:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.382821:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.382826:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.382847:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.382856:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.382863:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.383112:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.383119:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.383129:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dccc00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.383132:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.383141:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.383155:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.383164:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.383166:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.383167:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.383228:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.383233:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000909c2055/0x8e1c8a3488e64a4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.383898:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.383904:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.383916:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.383919:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.383924:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.383934:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.383954:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.383962:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.384123:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.384130:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.384139:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.384142:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.384152:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.384178:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.384188:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.384191:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.384194:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.384228:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.384233:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce150de7/0x8e1c8a3488e64a56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782229149.384400:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1782229149.384551:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.385189:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.385195:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.385206:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.385209:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.385214:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.385224:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.385234:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.385372:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.385394:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782229149.385529:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.385536:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.385545:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.385550:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.385559:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.385573:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.385580:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a174acd7/0x8e1c8a3488e64a5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.385594:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.385596:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.385597:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.386226:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.386232:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.386352:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.386355:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.386360:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.386381:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.386390:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.386398:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.386784:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782229149.387175:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.387183:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.387198:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.387201:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.387206:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.387217:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.387225:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.387233:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387549:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782229149.387555:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387564:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.387569:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387578:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387593:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387601:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d641e4b/0x8e1c8a3488e64a64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387616:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.387619:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387625:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcd800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.387628:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387636:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387666:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.387674:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.387675:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.387677:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.387949:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.387955:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81d7148/0x8e1c8a3488e64a6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.388110:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.388827:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.388835:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.388846:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.388849:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.388855:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.388877:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.388886:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.388895:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.392049:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782229149.392982:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.392992:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.393009:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.393013:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.393019:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.393032:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.393041:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.393059:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393200:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782229149.393208:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393217:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcdc00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.393221:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393231:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393614:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393624:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b4abee/0x8e1c8a3488e64a72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393644:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.393656:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393670:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcde00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.393674:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393681:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393692:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.393700:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.393701:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.393703:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.393939:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.393945:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146dffd7/0x8e1c8a3488e64a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.394619:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.394626:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.394636:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.394640:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.394744:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.394758:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.394768:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.394776:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.394882:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.394888:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.394896:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.394899:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.394909:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.394921:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.394936:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.394937:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.394939:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.394969:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.394974:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2ad801/0x8e1c8a3488e64a80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.395102:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.395823:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.395830:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.395840:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.395843:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.395848:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.395858:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.395866:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.395874:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.395922:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782229149.396387:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.396393:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.396531:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.396534:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.396539:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.396548:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.396556:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.396564:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396708:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782229149.396715:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396722:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.396727:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396735:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396748:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396756:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ab75898/0x8e1c8a3488e64a87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396771:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.396773:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396779:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.396788:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396795:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396805:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.396812:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.396814:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.396815:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.396872:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.396877:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6cd8dcf/0x8e1c8a3488e64a8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.397524:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.397531:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.397541:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.397544:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.397548:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.397569:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.397578:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.397584:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.397876:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.397883:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.397892:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420800 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.397895:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.397904:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.397917:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.397926:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.397934:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.397935:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.397992:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.397997:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f842dbf4/0x8e1c8a3488e64a95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.398833:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.398840:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.398852:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.398855:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.398859:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.398869:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.398888:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.398896:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.398938:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.398944:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.398951:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74420a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.398955:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.398964:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.398975:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.398983:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.398985:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.398986:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.399046:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.399051:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004534f065/0x8e1c8a3488e64a9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.399623:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.399630:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.399639:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.399642:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.399752:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.399763:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.399772:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.399790:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.399834:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.399840:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.399848:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.399851:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.399860:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.399877:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.399885:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.399886:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.399888:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.399944:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.399949:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc56010c/0x8e1c8a3488e64aa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.400542:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.400548:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.400557:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.400560:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.400565:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.400575:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.400583:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.400590:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.400736:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.400742:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.400750:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe74421200 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.400753:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.400762:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.400773:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.400780:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.400781:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.400783:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.400836:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782229149.400841:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007682d6d9/0x8e1c8a3488e64aaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229149.401416:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.401422:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.401455:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.401458:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.401463:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.401472:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.401481:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.401488:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.401570:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229149.401576:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.401594:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030c00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229149.401598:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.401605:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.401638:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782229149.401659:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.402009:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.402014:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.402046:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.402049:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.402054:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.402062:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.402071:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.402078:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.402100:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229149.403144:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229149.403153:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.403164:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.403168:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.403177:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.403191:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.403206:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f8aca90/0x8e1c8a3488e64ab8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.403225:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.403227:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.403228:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.407714:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.407734:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407753:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.407758:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.407764:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407779:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407801:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407810:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407835:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782229149.407852:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229149.407857:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407865:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:2.0:1782229149.407869:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407879:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407894:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407901:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64abf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.407920:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.407926:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229149.407928:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.408415:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.408421:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.414784:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.414796:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.414821:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.414843:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.414856:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.414864:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.414933:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229149.415108:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229149.415117:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.415127:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031400 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.415132:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.415142:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.415162:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.415170:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076f1840c/0x8e1c8a3488e64ac6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.415193:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.415196:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.415198:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229149.416834:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229149.416857:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f0bc25/0x8e1c8a3488e64ab1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.417131:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.417134:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.417137:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.417489:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.417499:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.417513:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.417517:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.417524:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.417545:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.417555:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.417848:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.417871:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229149.417901:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229149.417908:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.417918:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40030000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.417923:0:14181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.417933:0:14181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.418013:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.418024:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51b5ad7/0x8e1c8a3488e64acd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.418103:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.418106:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.418107:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.418582:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.418589:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.418601:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.418605:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.418620:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.418633:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.418642:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.420602:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.420768:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782229149.420787:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229149.420796:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.420807:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.420818:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.420830:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.420851:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.420859:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005864ec5b/0x8e1c8a3488e64ad4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.420881:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.420883:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.420886:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782229149.421479:0:14829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782229149.421486:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.421500:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1782229149.421504:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229149.421510:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.421523:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.421533:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.421541:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229149.421621:0:14829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1782229149.421819:0:14829:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1782229149.421913:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14218:x1868802329511296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96978us (98246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229149.421929:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782229149.422066:0:14218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14218:1868802329511296:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782229149.422083:0:14218:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1782229149.422130:0:14218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14218:1868802329511424:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782229149.422167:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229149.422211:0:14218:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b000 going to sleep for 11 seconds 00000100:00100000:3.0:1782229149.422242:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511424 00000100:00100000:3.0:1782229149.422248:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511424 00000100:00100000:3.0:1782229149.422285:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782229149.422293:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14218:x1868802329511424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1782229149.422327:0:14830:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1782229149.426149:0:15357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229149.426162:0:15357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.426176:0:15357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229149.426182:0:15357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.426194:0:15357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.426215:0:15357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.426242:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce4408b/0x8e1c8a3488e64adb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229149.426265:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.426266:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229149.426268:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782229149.429906:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14218:x1868802329511424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7604us (7730us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1782229149.429921:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782229149.430200:0:14218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14218:1868802329511424:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782229149.430215:0:14218:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1782229150.204723:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782229151.178167:0:15855:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782229151.228613:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229151.355841:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782229151.355866:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329511552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782229151.355935:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229151.356002:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511552 00000100:00100000:0.0:1782229151.356011:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511552 00000100:00100000:0.0:1782229151.356067:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782229151.356075:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329511552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782229151.356107:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229151.356151:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329511552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229151.356157:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1782229151.356180:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229151.356224:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329511552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782229152.258255:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229153.250867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229153.251168:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309595904 00000100:00100000:3.0:1782229153.251180:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309595904 00000100:00100000:3.0:1782229153.251227:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 74 00000100:00100000:3.0:1782229153.251236:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2369:x1868802309595904:12345-192.168.204.22@tcp:250:mount.lustre.0 00010000:00080000:3.0:1782229153.251281:0:14186:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7@192.168.204.22@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1782229153.251320:0:14186:0:(genops.c:1406:class_connect()) connect: client b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7, cookie 0x8e1c8a3488e64ae2 00000100:00080000:3.0:1782229153.251486:0:14186:0:(import.c:65:import_set_state_nolock()) ffff98fd432b8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782229153.251557:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+5:2369:x1868802309595904:12345-192.168.204.22@tcp:250:mount.lustre.0 Request processed in 321us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229153.251566:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 74 00000100:00100000:1.0:1782229153.261888:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229153.262003:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596032 00000100:00100000:0.0:1782229153.262014:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596032 00000100:00100000:0.0:1782229153.262073:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 75 00000100:00100000:0.0:1782229153.262084:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+5:13733:x1868802309596032:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782229153.262101:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229153.262119:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe59e23200/0x8e1c8a3488e64ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949ad0 expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229153.262150:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe59e23200/0x8e1c8a3488e64ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ad0 expref: 6 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229153.262162:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe59e23200/0x8e1c8a3488e64ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ad0 expref: 6 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229153.262173:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23200, rc 0) 00000100:00100000:0.0:1782229153.262260:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+6:13733:x1868802309596032:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229153.262268:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 75 00000100:00100000:0.0:1782229153.268477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.268841:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596160 00000100:00100000:2.0:1782229153.268851:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596160 00000100:00100000:2.0:1782229153.268913:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 76 00000100:00100000:2.0:1782229153.268924:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+6:13733:x1868802309596160:12345-192.168.204.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782229153.269276:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+6:13733:x1868802309596160:12345-192.168.204.22@tcp:501:mount.lustre.0 Request processed in 353us (808us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782229153.269285:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 76 00000100:00100000:2.0:1782229153.281849:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229153.281932:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596288 00000100:00100000:3.0:1782229153.281942:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596288 00000100:00100000:3.0:1782229153.281995:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 77 00000100:00100000:3.0:1782229153.282005:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+6:13733:x1868802309596288:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782229153.282020:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229153.282036:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e64af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949ad7 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.282063:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e64af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ad7 expref: 7 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.282073:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50917600/0x8e1c8a3488e64af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ad7 expref: 7 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.282081:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917600, rc 0) 00000100:00100000:3.0:1782229153.282144:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+7:13733:x1868802309596288:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 139us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229153.282171:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 77 00010000:00010000:1.0:1782229153.282787:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229153.284768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229153.285727:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596416 00000100:00100000:0.0:1782229153.285738:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596416 00000100:00100000:0.0:1782229153.285805:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 78 00000100:00100000:0.0:1782229153.285816:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+7:13733:x1868802309596416:12345-192.168.204.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782229153.286132:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13733:x1868802309596416:12345-192.168.204.22@tcp:501:mount.lustre.0 Request processed in 317us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229153.286152:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 78 00000100:00100000:0.0:1782229153.295121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.303969:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596544 00000100:00100000:2.0:1782229153.303987:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596544 00000100:00100000:2.0:1782229153.304055:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 79 00000100:00100000:2.0:1782229153.304064:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13733:x1868802309596544:12345-192.168.204.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782229153.304332:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13733:x1868802309596544:12345-192.168.204.22@tcp:503:mount.lustre.0 Request processed in 267us (9221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229153.304340:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 79 00000100:00100000:2.0:1782229153.312861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229153.313043:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596672 00000100:00100000:3.0:1782229153.313054:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596672 00000100:00100000:3.0:1782229153.313110:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 80 00000100:00100000:3.0:1782229153.313120:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13751:x1868802309596672:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782229153.313562:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13751:x1868802309596672:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 442us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229153.313570:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 80 00000100:00100000:1.0:1782229153.351696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229153.352647:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596800 00000100:00100000:0.0:1782229153.352658:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596800 00000100:00100000:0.0:1782229153.352879:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00100000:0.0:1782229153.352890:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13751:x1868802309596800:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782229153.353194:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13751:x1868802309596800:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 305us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229153.353203:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 81 00000100:00100000:0.0:1782229153.360835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229153.361029:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309596928 00000100:00100000:3.0:1782229153.361040:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309596928 00000100:00100000:3.0:1782229153.361152:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 82 00000100:00100000:3.0:1782229153.361163:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+8:13733:x1868802309596928:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782229153.361180:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229153.361198:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916600/0x8e1c8a3488e64af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b01 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.361225:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916600/0x8e1c8a3488e64af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b01 expref: 9 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.361237:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916600/0x8e1c8a3488e64af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b01 expref: 9 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.361245:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916600, rc 0) 00000100:00100000:3.0:1782229153.361319:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+9:13733:x1868802309596928:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 157us (3367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229153.361327:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 82 00000100:00100000:3.0:1782229153.364884:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229153.365000:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597056 00000100:00100000:0.0:1782229153.365009:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597056 00000100:00100000:0.0:1782229153.365063:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 83 00000100:00100000:0.0:1782229153.365073:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+9:13733:x1868802309597056:12345-192.168.204.22@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782229153.365099:0:14188:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782229153.365123:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782229153.365128:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782229153.365131:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782229153.365133:0:14188:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1782229153.367674:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+9:13733:x1868802309597056:12345-192.168.204.22@tcp:256:mount.lustre.0 Request processed in 2592us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229153.367801:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 83 00000100:00100000:2.0:1782229153.371995:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229153.372125:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597184 00000100:00100000:3.0:1782229153.372137:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597184 00000100:00100000:3.0:1782229153.372189:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 84 00000100:00100000:3.0:1782229153.372199:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+9:13733:x1868802309597184:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782229153.372218:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229153.372233:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b08 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.372260:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 10 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.372270:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 10 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229153.372278:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916a00, rc 0) 00000100:00100000:3.0:1782229153.372351:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bd42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13733:x1868802309597184:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229153.372357:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 84 00000100:00100000:3.0:1782229153.376127:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229153.376235:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597312 00000100:00100000:0.0:1782229153.376255:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597312 00000100:00100000:0.0:1782229153.376316:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00100000:0.0:1782229153.376327:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13733:x1868802309597312:12345-192.168.204.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782229153.376885:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13733:x1868802309597312:12345-192.168.204.22@tcp:501:mount.lustre.0 Request processed in 558us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229153.376894:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 85 00000100:00100000:1.0:1782229153.387017:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.387111:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597440 00000100:00100000:2.0:1782229153.387129:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597440 00000100:00100000:2.0:1782229153.387238:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 86 00000100:00100000:2.0:1782229153.387248:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13733:x1868802309597440:12345-192.168.204.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782229153.388127:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13733:x1868802309597440:12345-192.168.204.22@tcp:503:mount.lustre.0 Request processed in 876us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229153.388136:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 86 00000100:00100000:2.0:1782229153.396045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229153.396561:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597568 00000100:00100000:1.0:1782229153.396572:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597568 00000100:00100000:1.0:1782229153.396631:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 87 00000100:00100000:1.0:1782229153.396641:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13757:x1868802309597568:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782229153.396913:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13757:x1868802309597568:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 273us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229153.396922:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 87 00000100:00100000:0.0:1782229153.408420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.408676:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597696 00000100:00100000:2.0:1782229153.408687:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597696 00000100:00100000:2.0:1782229153.408752:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 88 00000100:00100000:2.0:1782229153.408764:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13757:x1868802309597696:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782229153.409056:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13757:x1868802309597696:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 292us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229153.409065:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 88 00000100:00100000:2.0:1782229153.430234:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229153.430465:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597824 00000100:00100000:3.0:1782229153.430475:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597824 00000100:00100000:3.0:1782229153.430529:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:3.0:1782229153.430538:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2369:x1868802309597824:12345-192.168.204.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782229153.430568:0:15355:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 1f693db6-2191-4110-8410-5abdf5d0b559@192.168.204.22@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1782229153.430615:0:15355:0:(genops.c:1406:class_connect()) connect: client 1f693db6-2191-4110-8410-5abdf5d0b559, cookie 0x8e1c8a3488e64b05 00000004:00100000:3.0:1782229153.430647:0:15355:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1782229153.430665:0:15355:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1782229153.472369:0:15355:0:(import.c:65:import_set_state_nolock()) ffff98fd432bf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782229153.473717:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+6:2369:x1868802309597824:12345-192.168.204.22@tcp:38:mount.lustre.0 Request processed in 43171us (43486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229153.473730:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:0.0:1782229153.478879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.478965:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598080 00000100:00100000:2.0:1782229153.478976:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598080 00000100:00100000:2.0:1782229153.479050:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:2.0:1782229153.479062:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+6:13733:x1868802309598080:12345-192.168.204.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782229153.479104:0:14193:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782229153.479191:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+6:13733:x1868802309598080:12345-192.168.204.22@tcp:41:mount.lustre.0 Request processed in 133us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229153.479199:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00080000:0.0:1782229153.479702:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229153.480997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.481126:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309597952 00000100:00100000:2.0:1782229153.481133:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309597952 00000100:00100000:2.0:1782229153.481180:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:2.0:1782229153.481190:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+6:0:x1868802309597952:12345-192.168.204.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782229153.481215:0:14194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782229153.481267:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+6:0:x1868802309597952:12345-192.168.204.22@tcp:41:mount.lustre.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229153.481273:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:3.0:1782229153.485535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.485840:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598208 00000100:00100000:2.0:1782229153.485865:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598208 00000100:00100000:2.0:1782229153.485926:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:2.0:1782229153.485937:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+6:13733:x1868802309598208:12345-192.168.204.22@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782229153.486025:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+6:13733:x1868802309598208:12345-192.168.204.22@tcp:40:mount.lustre.0 Request processed in 90us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229153.486035:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:0.0:1782229153.492564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229153.492596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229153.492681:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598592 00000100:00100000:3.0:1782229153.492691:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598592 00000100:00100000:3.0:1782229153.492744:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:3.0:1782229153.492754:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+6:13733:x1868802309598592:12345-192.168.204.22@tcp:33:mount.lustre.0 00000004:00080000:3.0:1782229153.493266:0:14196:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 452us 00000100:00100000:0.0:1782229153.496877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229153.501407:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598336 00000100:00100000:1.0:1782229153.501421:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598336 00000100:00100000:1.0:1782229153.501515:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598464 00000100:00100000:1.0:1782229153.501518:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598464 00000100:00100000:1.0:1782229153.501541:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:1.0:1782229153.501550:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2369:x1868802309598336:12345-192.168.204.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782229153.501581:0:15509:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 1f693db6-2191-4110-8410-5abdf5d0b559@192.168.204.22@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1782229153.501608:0:15509:0:(genops.c:1406:class_connect()) connect: client 1f693db6-2191-4110-8410-5abdf5d0b559, cookie 0x8e1c8a3488e64b0c 00002000:00100000:1.0:1782229153.501620:0:15509:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1f693db6-2191-4110-8410-5abdf5d0b559/ffff98fd420c6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782229153.501643:0:15509:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782229153.502358:0:15509:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782229153.502396:0:15509:0:(import.c:65:import_set_state_nolock()) ffff98fd420c0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782229153.502611:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+6:2369:x1868802309598336:12345-192.168.204.22@tcp:8:mount.lustre.0 Request processed in 1060us (10012us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229153.502621:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:1.0:1782229153.502646:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:1.0:1782229153.502651:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2369:x1868802309598464:12345-192.168.204.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782229153.502671:0:15509:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 1f693db6-2191-4110-8410-5abdf5d0b559@192.168.204.22@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1782229153.502690:0:15509:0:(genops.c:1406:class_connect()) connect: client 1f693db6-2191-4110-8410-5abdf5d0b559, cookie 0x8e1c8a3488e64b13 00002000:00100000:1.0:1782229153.502697:0:15509:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1f693db6-2191-4110-8410-5abdf5d0b559/ffff98fd420c5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782229153.502714:0:15509:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782229153.502908:0:15509:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782229153.502925:0:15509:0:(import.c:65:import_set_state_nolock()) ffff98fd420c4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782229153.502953:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+6:2369:x1868802309598464:12345-192.168.204.22@tcp:8:mount.lustre.0 Request processed in 300us (6085us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229153.502959:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000004:00200000:3.0:1782229153.509020:0:14196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782229153.509202:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+6:13733:x1868802309598592:12345-192.168.204.22@tcp:33:mount.lustre.0 Request processed in 16443us (16640us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229153.509213:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:0.0:1782229153.850878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229153.851016:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598720 00000100:00100000:2.0:1782229153.851028:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598720 00000100:00100000:2.0:1782229153.851091:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:2.0:1782229153.851102:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+6:13778:x1868802309598720:12345-192.168.204.22@tcp:101:mkdir.0 00010000:00010000:2.0:1782229153.851125:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229153.851156:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030000/0x8e1c8a3488e64b1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b32 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229153.851230:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64b21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229153.851245:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229153.851261:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229153.851547:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782229153.851552:0:14194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229153.854366:0:14194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229153.854449:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030000/0x8e1c8a3488e64b1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b32 expref: 8 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229153.854490:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64b21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b32 expref: 7 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229153.854501:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:2.0:1782229153.854504:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229153.854508:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031400, rc 0) 00000100:00100000:2.0:1782229153.854582:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+7:13778:x1868802309598720:12345-192.168.204.22@tcp:101:mkdir.0 Request processed in 3480us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229153.854592:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00010000:00010000:1.0:1782229154.300812:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229154.428888:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329512064:0@lo:400:kworker.0 00000100:00100000:2.0:1782229154.428953:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229154.429013:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782229154.429019:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329511936:0@lo:400:kworker.0 00000100:00100000:2.0:1782229154.429049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229154.429085:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512064 00000100:00100000:2.0:1782229154.429093:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512064 00000100:00100000:2.0:1782229154.429133:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782229154.429142:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329512064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229154.429191:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6ee3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1868802329512064:12345-0@lo:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229154.429198:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782229154.429236:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1868802329512064:0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432346:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329511680:0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229154.432465:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329512192:0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229154.432519:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782229154.432525:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329511808:0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229154.432565:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe6ee38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329512320:0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432586:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229154.432619:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511936 00000100:00100000:1.0:1782229154.432626:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511936 00000100:00100000:1.0:1782229154.432674:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511808 00000100:00100000:1.0:1782229154.432677:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511808 00000100:00100000:1.0:1782229154.432700:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782229154.432709:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1868802329511936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432756:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1868802329511936:12345-0@lo:400:kworker.0 Request processed in 48us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229154.432763:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782229154.432778:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782229154.432784:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329511808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432815:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329511808:12345-0@lo:400:kworker.0 Request processed in 31us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229154.432821:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782229154.432837:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512192 00000100:00100000:1.0:1782229154.432840:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512192 00000100:00100000:1.0:1782229154.432863:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512320 00000100:00100000:1.0:1782229154.432873:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512320 00000100:00100000:1.0:1782229154.432891:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782229154.432897:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329512192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432930:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329512192:12345-0@lo:400:kworker.0 Request processed in 33us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229154.432936:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782229154.432947:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782229154.432953:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329512320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.432977:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868802329512320:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229154.432984:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782229154.433000:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329511680 00000100:00100000:1.0:1782229154.433003:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329511680 00000100:00100000:1.0:1782229154.433024:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782229154.433029:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3308:x1868802329511680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782229154.433056:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3308:x1868802329511680:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229154.433062:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782229154.433139:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329512448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782229154.433169:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229154.433314:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329511936:0@lo:400:kworker.0 00000100:00100000:0.0:1782229154.433342:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512448 00000100:00100000:0.0:1782229154.433345:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512448 00000100:00100000:0.0:1782229154.433369:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782229154.433376:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1868802329512448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782229154.433389:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229154.433426:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1868802329512448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229154.433455:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782229154.433487:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329512448:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782229154.433599:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782229154.433604:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782229154.433613:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782229154.433635:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329511808:0@lo:400:kworker.0 00000100:00100000:0.0:1782229154.433645:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1868802329512320:0@lo:400:kworker.0 00000100:00100000:0.0:1782229154.433652:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329511680:0@lo:400:kworker.0 00000100:00100000:0.0:1782229154.433661:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe6ee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329512192:0@lo:400:kworker.0 00000001:00100000:2.0:1782229154.527886:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1782229154.527901:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1f693db6-2191-4110-8410-5abdf5d0b559 00000001:00080000:2.0:1782229154.527963:0:7508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1782229155.325476:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229156.292728:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229156.292841:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598848 00000100:00100000:1.0:1782229156.292852:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598848 00000100:00100000:1.0:1782229156.292939:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:1.0:1782229156.292949:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+7:13830:x1868802309598848:12345-192.168.204.22@tcp:41:lfs.0 00000004:00000024:1.0:1782229156.292992:0:14195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782229156.293083:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+7:13830:x1868802309598848:12345-192.168.204.22@tcp:41:lfs.0 Request processed in 135us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.293107:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00080000:0.0:1782229156.293186:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229156.310940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.311097:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309598976 00000100:00100000:2.0:1782229156.311109:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309598976 00000100:00100000:1.0:1782229156.311226:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:1.0:1782229156.311252:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1f693db6-2191-4110-8410-5abdf5d0b559+6:13830:x1868802309598976:12345-192.168.204.22@tcp:13:lfs.0 00002000:00000024:1.0:1782229156.311294:0:14832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229156.311387:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1f693db6-2191-4110-8410-5abdf5d0b559+6:13830:x1868802309598976:12345-192.168.204.22@tcp:13:lfs.0 Request processed in 138us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.311394:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00080000:0.0:1782229156.311613:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229156.318383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229156.319106:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309599104 00000100:00100000:1.0:1782229156.319118:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309599104 00000100:00100000:1.0:1782229156.319335:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:1.0:1782229156.319346:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1f693db6-2191-4110-8410-5abdf5d0b559+5:13830:x1868802309599104:12345-192.168.204.22@tcp:13:lfs.0 00002000:00000024:1.0:1782229156.319399:0:14832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229156.319551:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1f693db6-2191-4110-8410-5abdf5d0b559+5:13830:x1868802309599104:12345-192.168.204.22@tcp:13:lfs.0 Request processed in 207us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.319559:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00080000:0.0:1782229156.327819:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782229156.351500:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229156.475774:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782229156.475800:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329512576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782229156.475869:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229156.476580:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512576 00000100:00100000:2.0:1782229156.476590:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512576 00000100:00100000:2.0:1782229156.476660:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782229156.476670:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329512576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782229156.476694:0:14832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229156.476755:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329512576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.476762:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782229156.476805:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329512576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782229156.476920:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1782229156.585578:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1f693db6-2191-4110-8410-5abdf5d0b559 00000100:00100000:3.0:1782229156.589641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.589775:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309599232 00000100:00100000:2.0:1782229156.589785:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309599232 00000100:00100000:2.0:1782229156.589844:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 90 00000100:00100000:2.0:1782229156.589854:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+10:13862:x1868802309599232:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782229156.589870:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229156.589888:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40031000/0x8e1c8a3488e64b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b39 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.589920:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40031000/0x8e1c8a3488e64b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b39 expref: 11 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.589931:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40031000/0x8e1c8a3488e64b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b39 expref: 11 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.589960:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031000, rc 0) 00000100:00100000:2.0:1782229156.590029:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13862:x1868802309599232:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 176us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.590036:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 90 00000100:00100000:3.0:1782229156.596606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229156.596711:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309599360 00000100:00100000:1.0:1782229156.596722:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309599360 00000100:00100000:1.0:1782229156.596783:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 91 00000100:00100000:1.0:1782229156.596794:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13862:x1868802309599360:12345-192.168.204.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782229156.597089:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13862:x1868802309599360:12345-192.168.204.22@tcp:501:mount.lustre.0 Request processed in 296us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.597104:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 91 00000100:00100000:3.0:1782229156.599121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229156.599315:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309599488 00000100:00100000:1.0:1782229156.599324:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309599488 00000100:00100000:1.0:1782229156.599387:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 92 00000100:00100000:1.0:1782229156.599397:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13862:x1868802309599488:12345-192.168.204.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782229156.601574:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13862:x1868802309599488:12345-192.168.204.22@tcp:503:mount.lustre.0 Request processed in 2169us (2462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.601587:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 92 00000100:00100000:3.0:1782229156.623807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.629537:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309599616 00000100:00100000:2.0:1782229156.629552:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309599616 00000100:00100000:2.0:1782229156.629628:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 93 00000100:00100000:2.0:1782229156.629640:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13868:x1868802309599616:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782229156.630976:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13868:x1868802309599616:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 1330us (7170us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.630987:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 93 00000100:00100000:2.0:1782229156.656412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229156.656586:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309599744 00000100:00100000:3.0:1782229156.656595:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309599744 00000100:00100000:3.0:1782229156.656658:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 94 00000100:00100000:3.0:1782229156.656669:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13868:x1868802309599744:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782229156.656953:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13868:x1868802309599744:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 284us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229156.656971:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 94 00000100:00100000:3.0:1782229156.671284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.671785:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309599872 00000100:00100000:2.0:1782229156.671795:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309599872 00000100:00100000:2.0:1782229156.671856:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 95 00000100:00100000:2.0:1782229156.671867:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13862:x1868802309599872:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782229156.671884:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229156.671900:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e64b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b63 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.671928:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e64b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b63 expref: 12 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.671939:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40030c00/0x8e1c8a3488e64b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b63 expref: 12 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.671963:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030c00, rc 0) 00000100:00100000:2.0:1782229156.672026:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13862:x1868802309599872:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 161us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.672033:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 95 00000100:00100000:2.0:1782229156.683719:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229156.683829:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600000 00000100:00100000:1.0:1782229156.683840:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600000 00000100:00100000:1.0:1782229156.683899:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 96 00000100:00100000:1.0:1782229156.683909:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13862:x1868802309600000:12345-192.168.204.22@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782229156.683939:0:14188:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782229156.683967:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782229156.683971:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782229156.683974:0:14188:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782229156.683976:0:14188:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1782229156.693560:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13862:x1868802309600000:12345-192.168.204.22@tcp:256:mount.lustre.0 Request processed in 9639us (9851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.693578:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 96 00000100:00100000:3.0:1782229156.702072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.702239:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600128 00000100:00100000:2.0:1782229156.702251:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600128 00000100:00100000:2.0:1782229156.702312:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 97 00000100:00100000:2.0:1782229156.702321:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13862:x1868802309600128:12345-192.168.204.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782229156.702337:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229156.702353:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b6a expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.702391:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 13 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.702402:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 13 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229156.702411:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031a00, rc 0) 00000100:00100000:2.0:1782229156.702530:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13862:x1868802309600128:12345-192.168.204.22@tcp:101:mount.lustre.0 Request processed in 201us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.702538:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 97 00000100:00100000:2.0:1782229156.705719:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229156.706267:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600256 00000100:00100000:1.0:1782229156.706277:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600256 00000100:00100000:1.0:1782229156.706383:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 98 00000100:00100000:1.0:1782229156.706395:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13862:x1868802309600256:12345-192.168.204.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782229156.706975:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7fe85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13862:x1868802309600256:12345-192.168.204.22@tcp:501:mount.lustre.0 Request processed in 579us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.706991:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 98 00000100:00100000:3.0:1782229156.709730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.711296:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600384 00000100:00100000:2.0:1782229156.711309:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600384 00000100:00100000:2.0:1782229156.711386:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 99 00000100:00100000:2.0:1782229156.711398:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13862:x1868802309600384:12345-192.168.204.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782229156.712023:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13862:x1868802309600384:12345-192.168.204.22@tcp:503:mount.lustre.0 Request processed in 626us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.712032:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 99 00000100:00100000:3.0:1782229156.717016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.717126:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600512 00000100:00100000:2.0:1782229156.717137:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600512 00000100:00100000:2.0:1782229156.717192:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 100 00000100:00100000:2.0:1782229156.717202:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13873:x1868802309600512:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782229156.717492:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13873:x1868802309600512:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 290us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.717505:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 100 00000100:00100000:3.0:1782229156.728487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229156.728550:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600640 00000100:00100000:0.0:1782229156.728560:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600640 00000100:00100000:0.0:1782229156.728620:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 101 00000100:00100000:0.0:1782229156.728631:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13873:x1868802309600640:12345-192.168.204.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782229156.729326:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74594850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13873:x1868802309600640:12345-192.168.204.22@tcp:502:llog_process_th.0 Request processed in 694us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229156.729335:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 101 00000100:00100000:3.0:1782229156.737342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229156.742718:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600768 00000100:00100000:1.0:1782229156.742735:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600768 00000100:00100000:1.0:1782229156.743715:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:1.0:1782229156.743726:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2369:x1868802309600768:12345-192.168.204.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782229156.743773:0:15355:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from afbb5fd9-ada8-4dd7-ad71-331ce2f77024@192.168.204.22@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1782229156.743820:0:15355:0:(genops.c:1406:class_connect()) connect: client afbb5fd9-ada8-4dd7-ad71-331ce2f77024, cookie 0x8e1c8a3488e64b3d 00000004:00100000:1.0:1782229156.743853:0:15355:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782229156.743991:0:15355:0:(import.c:65:import_set_state_nolock()) ffff98fd4130e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782229156.744077:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2369:x1868802309600768:12345-192.168.204.22@tcp:38:mount.lustre.0 Request processed in 351us (6745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.744084:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:3.0:1782229156.750989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229156.752169:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229156.754965:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601024 00000100:00100000:2.0:1782229156.754980:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601024 00000100:00100000:1.0:1782229156.755126:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:1.0:1782229156.755140:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:13862:x1868802309601024:12345-192.168.204.22@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782229156.755173:0:15355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782229156.755267:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:13862:x1868802309601024:12345-192.168.204.22@tcp:41:mount.lustre.0 Request processed in 131us (4289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.755275:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00080000:0.0:1782229156.755672:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229156.764102:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229156.764456:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309600896 00000100:00100000:0.0:1782229156.764469:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309600896 00000100:00100000:0.0:1782229156.764536:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601152 00000100:00100000:0.0:1782229156.764541:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601152 00000100:00100000:0.0:1782229156.764563:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:0.0:1782229156.764575:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+7:0:x1868802309600896:12345-192.168.204.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782229156.764620:0:14194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782229156.765123:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+7:0:x1868802309600896:12345-192.168.204.22@tcp:41:mount.lustre.0 Request processed in 547us (12955us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229156.765150:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:0.0:1782229156.765174:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:0.0:1782229156.765182:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:13862:x1868802309601152:12345-192.168.204.22@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782229156.765216:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:13862:x1868802309601152:12345-192.168.204.22@tcp:40:mount.lustre.0 Request processed in 35us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229156.765234:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:0.0:1782229156.774406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229156.774489:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229156.774509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229156.774554:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601280 00000100:00100000:0.0:1782229156.774563:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601280 00000100:00100000:0.0:1782229156.774599:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601408 00000100:00100000:0.0:1782229156.774602:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601408 00000100:00100000:0.0:1782229156.774620:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:0.0:1782229156.774627:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2369:x1868802309601280:12345-192.168.204.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782229156.774670:0:14827:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from afbb5fd9-ada8-4dd7-ad71-331ce2f77024@192.168.204.22@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:0.0:1782229156.774700:0:14827:0:(genops.c:1406:class_connect()) connect: client afbb5fd9-ada8-4dd7-ad71-331ce2f77024, cookie 0x8e1c8a3488e64b44 00002000:00100000:0.0:1782229156.774722:0:14827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli afbb5fd9-ada8-4dd7-ad71-331ce2f77024/ffff98fe6f6a6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782229156.774733:0:14827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1782229156.775121:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:1.0:1782229156.775127:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2369:x1868802309601408:12345-192.168.204.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782229156.775145:0:15509:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from afbb5fd9-ada8-4dd7-ad71-331ce2f77024@192.168.204.22@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1782229156.775163:0:15509:0:(genops.c:1406:class_connect()) connect: client afbb5fd9-ada8-4dd7-ad71-331ce2f77024, cookie 0x8e1c8a3488e64b4b 00002000:00100000:1.0:1782229156.775168:0:15509:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli afbb5fd9-ada8-4dd7-ad71-331ce2f77024/ffff98fd4130f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782229156.775188:0:15509:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782229156.775466:0:15509:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782229156.775498:0:15509:0:(import.c:65:import_set_state_nolock()) ffff98fd41309800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782229156.775585:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2369:x1868802309601408:12345-192.168.204.22@tcp:8:mount.lustre.0 Request processed in 455us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229156.775593:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:2.0:1782229156.776292:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601536 00000100:00100000:2.0:1782229156.776301:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601536 00000100:00100000:2.0:1782229156.776348:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:2.0:1782229156.776356:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:13862:x1868802309601536:12345-192.168.204.22@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782229156.776903:0:14197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1782229156.777051:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:13862:x1868802309601536:12345-192.168.204.22@tcp:33:mount.lustre.0 Request processed in 695us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229156.777060:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1 00002000:00080000:0.0:1782229156.779469:0:14827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782229156.779512:0:14827:0:(import.c:65:import_set_state_nolock()) ffff98fe6f6a5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782229156.779587:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2369:x1868802309601280:12345-192.168.204.22@tcp:8:mount.lustre.0 Request processed in 4958us (5096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229156.779597:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:0.0:1782229157.102742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229157.102863:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601664 00000100:00100000:2.0:1782229157.102873:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601664 00000100:00100000:2.0:1782229157.102938:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:2.0:1782229157.102954:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:13894:x1868802309601664:12345-192.168.204.22@tcp:101:mkdir.0 00010000:00010000:2.0:1782229157.102988:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229157.103008:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b94 expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229157.103081:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229157.103107:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229157.103124:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229157.103321:0:14195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782229157.103325:0:14195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229157.103398:0:14195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229157.103423:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 8 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229157.103510:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 7 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229157.103519:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:2.0:1782229157.103522:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229157.103526:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030600, rc 0) 00000100:00100000:2.0:1782229157.103592:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+7:13894:x1868802309601664:12345-192.168.204.22@tcp:101:mkdir.0 Request processed in 645us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229157.103600:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00010000:00010000:1.0:1782229157.371694:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782229158.397211:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782229158.565553:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of afbb5fd9-ada8-4dd7-ad71-331ce2f77024 00000001:00100000:1.0:1782229158.565572:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1f693db6-2191-4110-8410-5abdf5d0b559 00000040:00080000:1.0:1782229158.784610:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782229159.419742:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229159.548137:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329512832:0@lo:400:kworker.0 00000100:00100000:0.0:1782229159.548218:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229159.548241:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329512960:0@lo:400:kworker.0 00000100:00100000:2.0:1782229159.548280:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229159.548292:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329513344:0@lo:400:kworker.0 00000100:00100000:2.0:1782229159.548314:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329513472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229159.548321:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512832 00000100:00100000:0.0:1782229159.548329:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229159.548330:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512832 00000100:00100000:2.0:1782229159.548347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229159.548362:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782229159.548371:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3309:1868802329512704:0@lo:400:kworker.0 00000100:00100000:2.0:1782229159.548372:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782229159.548383:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329513088:0@lo:400:kworker.0 00000100:00100000:0.0:1782229159.548415:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229159.548421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229159.548482:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329513216:0@lo:400:kworker.0 00000100:00100000:1.0:1782229159.548489:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512960 00000100:00100000:1.0:1782229159.548495:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512960 00000100:00100000:2.0:1782229159.548517:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329513472 00000100:00100000:0.0:1782229159.548517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229159.548523:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329513472 00000100:00100000:1.0:1782229159.548533:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782229159.548547:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329512832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229159.548562:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329513344 00000100:00100000:2.0:1782229159.548563:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782229159.548570:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329513344 00000100:00100000:2.0:1782229159.548575:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329513472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782229159.548606:0:14832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229159.548615:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329512832:12345-0@lo:400:kworker.0 Request processed in 71us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229159.548624:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782229159.548651:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1868802329513472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229159.548658:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782229159.548662:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782229159.548673:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329512960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229159.548697:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782229159.548699:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329513088 00000100:00100000:0.0:1782229159.548705:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329513088 00000100:00100000:2.0:1782229159.548734:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329513472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229159.549455:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329512960:12345-0@lo:400:kworker.0 Request processed in 697us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229159.549466:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1782229159.549510:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782229159.549523:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782229159.549527:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782229159.550085:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329512704 00000100:00100000:2.0:1782229159.550091:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329512704 00000100:00100000:2.0:1782229159.550119:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782229159.550126:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3309:x1868802329512704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229159.550185:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3309:x1868802329512704:12345-0@lo:400:kworker.0 Request processed in 59us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229159.550191:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782229159.557763:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329513216 00000100:00100000:3.0:1782229159.557778:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329513216 00000100:00100000:3.0:1782229159.557951:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782229159.557963:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329513344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558070:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1868802329513344:12345-0@lo:400:kworker.0 Request processed in 108us (9741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229159.558077:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782229159.558099:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782229159.558106:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329513088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558137:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1868802329513088:12345-0@lo:400:kworker.0 Request processed in 31us (9719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229159.558143:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782229159.558154:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782229159.558160:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329513216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558199:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329513216:12345-0@lo:400:kworker.0 Request processed in 39us (9684us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229159.558220:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1782229159.558240:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229159.558322:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1868802329513088:0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558338:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329512960:0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558381:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3309:1868802329512704:0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558393:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329513216:0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558405:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329512832:0@lo:400:kworker.0 00000100:00100000:3.0:1782229159.558420:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1868802329513344:0@lo:400:kworker.0 00000001:00100000:2.0:1782229159.640716:0:7508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of afbb5fd9-ada8-4dd7-ad71-331ce2f77024 00010000:00010000:1.0:1782229160.443888:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782229160.676313:0:16062:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782229161.471943:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229161.597168:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329513600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782229161.597261:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229161.598901:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329513600 00000100:00100000:0.0:1782229161.598911:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329513600 00000100:00100000:0.0:1782229161.598974:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782229161.598986:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329513600:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782229161.599010:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782229161.599021:0:14832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229161.599097:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329513600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229161.599105:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782229161.604014:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329513600:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1782229161.625552:0:6623:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of afbb5fd9-ada8-4dd7-ad71-331ce2f77024 00000100:00100000:2.0:1782229162.049272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229162.049326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229162.049357:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229162.049385:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229162.049404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229162.049422:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229162.049473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229162.049506:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602048 00000100:00100000:3.0:1782229162.049511:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602304 00000100:00100000:2.0:1782229162.049516:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602048 00000100:00100000:3.0:1782229162.049518:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602304 00000100:00100000:2.0:1782229162.049575:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602560 00000100:00100000:3.0:1782229162.049577:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601920 00000100:00100000:2.0:1782229162.049580:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602560 00000100:00100000:3.0:1782229162.049582:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601920 00000100:00100000:2.0:1782229162.049601:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602176 00000100:00100000:2.0:1782229162.049605:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602176 00000100:00100000:3.0:1782229162.049620:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:2.0:1782229162.049625:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602432 00000100:00100000:2.0:1782229162.049628:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602432 00000100:00100000:3.0:1782229162.049633:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2373:x1868802309602304:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229162.049646:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:2.0:1782229162.049654:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+5:2373:x1868802309602048:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229162.049770:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309601792 00000100:00100000:0.0:1782229162.049774:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309601792 00000100:00100000:0.0:1782229162.049802:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 103 00000100:00100000:0.0:1782229162.049809:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2373:x1868802309601792:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229162.049891:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:1.0:1782229162.049900:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309602560:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229162.049965:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+5:2373:x1868802309602048:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 310us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229162.049974:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:2.0:1782229162.049992:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:2.0:1782229162.049998:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+5:2373:x1868802309602176:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229162.059102:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2373:x1868802309602304:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 9460us (9731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229162.059129:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:0.0:1782229162.059288:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2373:x1868802309601792:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 9476us (10024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229162.059298:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 103 00000100:00100000:1.0:1782229162.059514:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309602560:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 9613us (10125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229162.059524:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:1.0:1782229162.059554:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:1.0:1782229162.059566:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309602432:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229162.059611:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309602432:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 51us (10139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229162.059617:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:2.0:1782229162.059924:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+5:2373:x1868802309602176:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 9923us (10498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229162.059932:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:3.0:1782229162.059955:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:3.0:1782229162.059967:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+6:2373:x1868802309601920:12345-192.168.204.22@tcp:400:kworker.0 00000100:00080000:2.0:1782229162.059981:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782229162.059988:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782229162.059992:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229162.060000:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+6:2373:x1868802309601920:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 35us (10593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229162.060007:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00010000:00010000:1.0:1782229162.492595:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229163.519973:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229164.540365:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782229164.582964:0:16212:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb34fef60 20000000:00000080:3.0:1782229164.582985:0:16212:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fd413d5800 uarg=0000000000000000 20000000:01000000:3.0:1782229164.583022:0:16212:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782229164.583027:0:16212:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782229164.583032:0:16212:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782229164.584011:0:16213:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1782229164.584162:0:16212:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782229164.590948:0:16212:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782229164.590982:0:16212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591000:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 18 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591008:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 18 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591015:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 18 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591025:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 12 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591032:0:16212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 12 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591041:0:16212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591097:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 12 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591115:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 12 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229164.591150:0:16212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329513728:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229164.591259:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 12 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591329:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 12 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229164.591339:0:16212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329513856:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229164.591369:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 18 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.591378:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 18 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229164.591386:0:16212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329513984:0@lo:104: 00000100:00100000:0.0:1782229164.591418:0:16212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229164.591493:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329513984 00000100:00100000:0.0:1782229164.591500:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329513984 00000100:00100000:0.0:1782229164.592362:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782229164.592374:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:16212:x1868802329513984:12345-0@lo:104: 00010000:00010000:0.0:1782229164.592387:0:14177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229164.592481:0:14177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782229164.592488:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:16212:x1868802329513984:12345-0@lo:104: Request processed in 117us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229164.592495:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782229164.592627:0:14181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782229164.592635:0:14181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.592641:0:14181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:1.0:1782229164.592645:0:14181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.592654:0:14181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782229164.592661:0:14181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229164.592673:0:14181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782229164.592706:0:14181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.592713:0:14181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782229164.592738:0:14181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.592746:0:14181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe50917000/0x8e1c8a3488e649d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e649df expref: -99 pid: 15497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.592758:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229164.592761:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229164.592762:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229164.594082:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782229164.594105:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3309:1868802329514112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782229164.594366:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 18 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.594379:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 18 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229164.594391:0:16212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329514240:0@lo:104: 00000100:00100000:1.0:1782229164.594425:0:16212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782229164.594475:0:16212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 18 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.594484:0:16212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 18 pid: 14187 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229164.594492:0:16212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329514368:0@lo:104: 00000100:00100000:1.0:1782229164.594653:0:16212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229164.594665:0:16212:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe505bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1782229164.594688:0:16212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329513984:0@lo:104: 00000100:00100000:2.0:1782229164.594981:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229164.595049:0:14176:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782229164.595061:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329514240 00000100:00100000:2.0:1782229164.595076:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329514240 00000100:00100000:2.0:1782229164.595109:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329514368 00000100:00100000:2.0:1782229164.595111:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329514368 00000100:00100000:2.0:1782229164.595125:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782229164.595132:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+4:16212:x1868802329514240:12345-0@lo:104: 00010000:00010000:2.0:1782229164.595145:0:14176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595196:0:14176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782229164.595202:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+4:16212:x1868802329514240:12345-0@lo:104: Request processed in 71us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229164.595456:0:16212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329514240:0@lo:104: 00000100:00100000:2.0:1782229164.595501:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782229164.595581:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782229164.595588:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe81ed1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:16212:x1868802329514368:12345-0@lo:104: 00010000:00010000:2.0:1782229164.595596:0:14176:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595674:0:14176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782229164.595680:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe81ed1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+3:16212:x1868802329514368:12345-0@lo:104: Request processed in 93us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229164.595698:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782229164.595738:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782229164.595744:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595751:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe81dcc600 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:2.0:1782229164.595755:0:14182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595763:0:14182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782229164.595770:0:14182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782229164.595775:0:14182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782229164.595799:0:14182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595805:0:14182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782229164.595821:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595828:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe81dcc600/0x8e1c8a3488e6489d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e648a4 expref: -99 pid: 14826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595839:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782229164.595841:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595856:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc1d50c20) 10000000:00010000:2.0:1782229164.595859:0:14182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595865:0:14182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782229164.595871:0:14182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782229164.595875:0:14182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782229164.595887:0:14182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595892:0:14182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782229164.595907:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595913:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.122@tcp lock: ffff98fe50916800/0x8e1c8a3488e64850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8e1c8a3488e64857 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.595927:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229164.595928:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229164.595930:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229164.595936:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229164.595942:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782229164.595952:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329514496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229164.595983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229164.596010:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329514624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229164.596039:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229164.596083:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329514112 00000100:00100000:2.0:1782229164.596088:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329514112 00010000:00010000:2.0:1782229164.596105:0:14178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 19 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229164.596119:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329514496 00000100:00100000:2.0:1782229164.596122:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329514496 00010000:00010000:2.0:1782229164.596133:0:14178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 20 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229164.596143:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329514624 00000100:00100000:2.0:1782229164.596144:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329514624 00010000:00010000:2.0:1782229164.596153:0:14178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 21 pid: 14187 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229164.596164:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782229164.596170:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+21:3309:x1868802329514112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782229164.596179:0:14178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229164.596184:0:14178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 21 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.596192:0:14178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 21 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.596204:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe59e23000/0x8e1c8a3488e649df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e649d8 expref: 21 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229164.596229:0:14178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229164.596253:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+20:3309:x1868802329514112:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229164.596375:0:14180:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782229164.596385:0:14180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1782229164.596511:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782229164.596531:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+20:3308:x1868802329514496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782229164.596540:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229164.596545:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 20 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.596553:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 20 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.596563:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe59e22200/0x8e1c8a3488e648a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e6489d expref: 20 pid: 14188 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.596572:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229164.596603:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3308:x1868802329514496:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229164.596609:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782229164.596623:0:14180:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782229164.596629:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782229164.596634:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:3310:x1868802329514624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782229164.596640:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229164.596650:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 18 pid: 14187 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.596658:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 18 pid: 14187 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.596667:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229164.596692:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:3310:x1868802329514624:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229164.596698:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782229164.596873:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782229164.596928:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329514624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229164.596953:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3308:1868802329514496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229164.596972:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3309:1868802329514112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782229164.599920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229164.600157:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229164.600262:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602688 00000100:00100000:3.0:1782229164.600359:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602688 00010000:00010000:3.0:1782229164.600399:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 13 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229164.600457:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602816 00000100:00100000:3.0:1782229164.600460:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602816 00010000:00010000:3.0:1782229164.600474:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 14 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229164.600493:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:3.0:1782229164.600502:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+14:2372:x1868802309602688:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229164.600585:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229164.600593:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 14 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600609:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 14 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600630:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229164.600688:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+14:2372:x1868802309602688:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 187us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229164.600696:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:3.0:1782229164.600715:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:3.0:1782229164.600722:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2372:x1868802309602816:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229164.600729:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229164.600734:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 13 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600743:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 13 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600755:0:14180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600765:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600780:0:14180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600787:0:14180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600793:0:14180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600799:0:14180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600805:0:14180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:3.0:1782229164.600816:0:14180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600825:0:14180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600833:0:14180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229164.600845:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229164.600865:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2372:x1868802309602816:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 144us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229164.600873:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00010000:00010000:1.0:1782229164.601859:0:16212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe81dcd400/0x8e1c8a3488e64857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8e1c8a3488e64850 expref: 16 pid: 14187 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229164.601877:0:16212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329514368:0@lo:104: 00010000:00010000:1.0:1782229164.601912:0:16212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe40031a00/0x8e1c8a3488e64b36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b6a expref: 12 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229164.601922:0:16212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329513728:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229164.601933:0:16212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe50916a00/0x8e1c8a3488e64afe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b08 expref: 11 pid: 14186 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229164.601941:0:16212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16212:1868802329513856:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229164.601971:0:16212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.601980:0:16212:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.601986:0:16212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229164.601992:0:16212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fe59e22a00/0x8e1c8a3488e64b60 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229164.667638:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329514752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782229164.667727:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229164.669510:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329514752 00000100:00100000:1.0:1782229164.669529:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329514752 00000100:00100000:1.0:1782229164.669591:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782229164.669601:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329514752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782229164.669637:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782229164.669718:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329514752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229164.669725:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782229164.669775:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329514752:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782229164.670222:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782229164.675731:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329514880:0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.675805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229164.675853:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782229164.675859:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329515008:0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.675883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229164.675907:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329515136:0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.675927:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229164.675941:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782229164.675945:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329515264:0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.675961:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229164.675984:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329514880 00000100:00100000:0.0:1782229164.675989:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329514880 00000100:00100000:0.0:1782229164.676041:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782229164.676051:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329514880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.676114:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329514880:12345-0@lo:400:kworker.0 Request processed in 64us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229164.676121:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782229164.676152:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515008 00000100:00100000:0.0:1782229164.676156:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515008 00000100:00100000:0.0:1782229164.676354:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515136 00000100:00100000:0.0:1782229164.676359:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515136 00000100:00100000:0.0:1782229164.676377:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515264 00000100:00100000:0.0:1782229164.676379:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515264 00000100:00100000:0.0:1782229164.676394:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782229164.676400:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329515008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.676458:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329515008:12345-0@lo:400:kworker.0 Request processed in 58us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229164.676465:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782229164.676486:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782229164.676492:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329515136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.676529:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1868802329515136:12345-0@lo:400:kworker.0 Request processed in 38us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229164.676535:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782229164.676548:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782229164.676554:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329515264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.676583:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329515264:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229164.676588:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782229164.676630:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329515008:0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.676644:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329514880:0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.676677:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329515264:0@lo:400:kworker.0 00000100:00100000:0.0:1782229164.676686:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1868802329515136:0@lo:400:kworker.0 00000100:00080000:2.0:1782229164.677674:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782229164.677681:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782229165.570522:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229166.151605:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229166.151647:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309602944 00000100:00100000:2.0:1782229166.151657:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309602944 00000100:00100000:2.0:1782229166.151707:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 104 00000100:00100000:2.0:1782229166.151717:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+11:13747:x1868802309602944:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782229166.151735:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229166.151754:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e64b67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949b9b expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229166.151780:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e64b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b9b expref: 12 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229166.151793:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe40030200/0x8e1c8a3488e64b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b9b expref: 12 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229166.151802:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030200, rc 0) 00000100:00100000:2.0:1782229166.151853:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13747:x1868802309602944:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 136us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229166.151874:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 104 00000100:00100000:0.0:1782229166.155796:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229166.156030:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603072 00000100:00100000:2.0:1782229166.156050:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603072 00000100:00100000:2.0:1782229166.156115:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 105 00000100:00100000:2.0:1782229166.156126:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13747:x1868802309603072:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782229166.156412:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13747:x1868802309603072:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 287us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229166.156420:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 105 00000100:00100000:2.0:1782229166.160294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229166.160447:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603200 00000100:00100000:3.0:1782229166.160457:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603200 00000100:00100000:3.0:1782229166.160507:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 106 00000100:00100000:3.0:1782229166.160517:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13747:x1868802309603200:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.160755:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13747:x1868802309603200:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 Request processed in 238us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.160762:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 106 00000100:00100000:2.0:1782229166.175816:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229166.176171:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603328 00000100:00100000:3.0:1782229166.176191:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603328 00000100:00100000:3.0:1782229166.176328:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 107 00000100:00100000:3.0:1782229166.176340:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+12:13747:x1868802309603328:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782229166.176660:0:14186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229166.176692:0:14186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916c00/0x8e1c8a3488e64b6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949ba2 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.176724:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916c00/0x8e1c8a3488e64b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ba2 expref: 13 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.176735:0:14186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916c00/0x8e1c8a3488e64b6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ba2 expref: 13 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.176744:0:14186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916c00, rc 0) 00000100:00100000:3.0:1782229166.176817:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74596050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13747:x1868802309603328:12345-192.168.204.22@tcp:101:ll_cfg_requeue.0 Request processed in 480us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.176824:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 107 00000100:00100000:3.0:1782229166.188334:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229166.188896:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603456 00000100:00100000:2.0:1782229166.188907:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603456 00000100:00100000:2.0:1782229166.188978:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 108 00000100:00100000:2.0:1782229166.188990:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13747:x1868802309603456:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782229166.189790:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13747:x1868802309603456:12345-192.168.204.22@tcp:501:ll_cfg_requeue.0 Request processed in 798us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229166.189800:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 108 00000100:00100000:1.0:1782229166.195330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229166.195560:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603584 00000100:00100000:3.0:1782229166.195580:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603584 00000100:00100000:3.0:1782229166.195637:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 109 00000100:00100000:3.0:1782229166.195647:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13747:x1868802309603584:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.195865:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74596450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:13747:x1868802309603584:12345-192.168.204.22@tcp:503:ll_cfg_requeue.0 Request processed in 219us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.195874:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 109 10000000:01000000:2.0:1782229166.204499:0:14190:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782229166.204507:0:14190:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fd42be5800 from 10 10000000:01000000:2.0:1782229166.204512:0:14190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782229166.204559:0:14190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e64b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229166.204584:0:14190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e64b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229166.204599:0:14190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e64b75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229166.204636:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782229166.204709:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229166.204765:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782229166.204924:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515392 00000100:00100000:3.0:1782229166.204932:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515392 00000100:00100000:3.0:1782229166.204989:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782229166.204999:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+16:14190:x1868802329515392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782229166.205016:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229166.205029:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916200/0x8e1c8a3488e64b7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64b75 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.205077:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916200/0x8e1c8a3488e64b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64b75 expref: 17 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.205088:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916200/0x8e1c8a3488e64b7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64b75 expref: 17 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.205096:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916200, rc 0) 00000100:00100000:3.0:1782229166.205139:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:14190:x1868802329515392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.205145:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782229166.205190:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782229166.205203:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e64b75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b7c expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.205212:0:14190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e64b75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64b7c expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229166.205265:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.205290:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229166.205305:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58fe5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782229166.205317:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515520 00000100:00100000:3.0:1782229166.205320:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515520 00000100:00100000:3.0:1782229166.205343:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782229166.205348:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:14190:x1868802329515520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.205636:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:14190:x1868802329515520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.205652:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782229166.205691:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.205719:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.205759:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229166.205782:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58fe5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782229166.205786:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515648 00000100:00100000:1.0:1782229166.205792:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515648 00000100:00100000:1.0:1782229166.205821:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782229166.205830:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:14190:x1868802329515648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782229166.206004:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:14190:x1868802329515648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229166.206012:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782229166.206100:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782229166.211673:0:16282:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782229166.213153:0:14190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782229166.213184:0:14190:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782229166.213196:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e64b75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b7c expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229166.213208:0:14190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe40030400/0x8e1c8a3488e64b75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b7c expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229166.213219:0:14190:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782229166.213221:0:14190:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fe6dd02000 from 10 10000000:01000000:1.0:1782229166.213223:0:14190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782229166.213257:0:14190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe7d015800/0x8e1c8a3488e64b83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229166.213272:0:14190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe7d015800/0x8e1c8a3488e64b83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229166.213284:0:14190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe7d015800/0x8e1c8a3488e64b83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229166.213309:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782229166.213374:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229166.213420:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096b780 going to sleep for 11 seconds 00000100:00100000:3.0:1782229166.214961:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515776 00000100:00100000:3.0:1782229166.214972:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515776 00000100:00100000:3.0:1782229166.215047:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782229166.215058:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+17:14190:x1868802329515776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782229166.215150:0:14187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229166.215169:0:14187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e64b8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64b83 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.215198:0:14187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e64b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64b83 expref: 18 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.215209:0:14187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50917800/0x8e1c8a3488e64b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64b83 expref: 18 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.215218:0:14187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917800, rc 0) 00000100:00100000:3.0:1782229166.216539:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:14190:x1868802329515776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1475us (3156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.216550:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782229166.217865:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782229166.217893:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe7d015800/0x8e1c8a3488e64b83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b8a expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229166.217912:0:14190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe7d015800/0x8e1c8a3488e64b83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64b8a expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229166.217989:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782229166.218056:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229166.218103:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782229166.218155:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329515904 00000100:00100000:3.0:1782229166.218167:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329515904 00000100:00100000:3.0:1782229166.218219:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782229166.218229:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:14190:x1868802329515904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.219161:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:14190:x1868802329515904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 930us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.219171:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782229166.219755:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329515904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782229166.219803:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782229166.219861:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229166.219899:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50cc8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782229166.220137:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329516032 00000100:00100000:0.0:1782229166.220144:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329516032 00000100:00100000:0.0:1782229166.220191:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782229166.220410:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:14190:x1868802329516032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782229166.220608:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:14190:x1868802329516032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229166.220614:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782229166.220980:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782229166.222997:0:16285:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782229166.223229:0:14190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782229166.223517:0:14190:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782229166.223538:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe7d015800/0x8e1c8a3488e64b83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b8a expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229166.223561:0:14190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe7d015800/0x8e1c8a3488e64b83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b8a expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782229166.223644:0:14190:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782229166.223648:0:14190:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff98fd42ec2800 from 10 10000000:01000000:1.0:1782229166.223652:0:14190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782229166.223690:0:14190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe7d015600/0x8e1c8a3488e64b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229166.223700:0:14190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.122@tcp lock: ffff98fe7d015600/0x8e1c8a3488e64b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229166.223711:0:14190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.122@tcp lock: ffff98fe7d015600/0x8e1c8a3488e64b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229166.223735:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782229166.223796:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229166.223841:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096be40 going to sleep for 11 seconds 00000100:00100000:3.0:1782229166.223896:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329516160 00000100:00100000:3.0:1782229166.223904:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329516160 00000100:00100000:3.0:1782229166.223955:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782229166.223963:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+18:14190:x1868802329516160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782229166.223977:0:14188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229166.223988:0:14188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fe50916400/0x8e1c8a3488e64b98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8e1c8a3488e64b91 expref: -99 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.224013:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fe50916400/0x8e1c8a3488e64b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8e1c8a3488e64b91 expref: 19 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.224024:0:14188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fe50916400/0x8e1c8a3488e64b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8e1c8a3488e64b91 expref: 19 pid: 14188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.224047:0:14188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916400, rc 0) 00000100:00100000:3.0:1782229166.224098:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329516160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.224105:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782229166.224180:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782229166.224204:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.122@tcp lock: ffff98fe7d015600/0x8e1c8a3488e64b91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b98 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229166.224213:0:14190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.122@tcp lock: ffff98fe7d015600/0x8e1c8a3488e64b91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8e1c8a3488e64b98 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229166.224262:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782229166.224289:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782229166.224313:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096be40 going to sleep for 11 seconds 00000100:00100000:3.0:1782229166.224355:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329516288 00000100:00100000:3.0:1782229166.224360:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329516288 00000100:00100000:3.0:1782229166.224421:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782229166.224446:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329516288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.224706:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329516288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229166.224712:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782229166.224928:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe446ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.224960:0:14190:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782229166.224996:0:14190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782229166.225058:0:14190:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58fe5000 going to sleep for 11 seconds 00000100:00100000:0.0:1782229166.225093:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329516416 00000100:00100000:0.0:1782229166.225098:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329516416 00000100:00100000:0.0:1782229166.225130:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782229166.225138:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329516416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782229166.225284:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:14190:x1868802329516416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229166.225291:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782229166.225332:0:14190:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:14190:1868802329516416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782229166.226173:0:16287:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782229166.226330:0:14190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782229166.226348:0:14190:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782229166.226358:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.122@tcp lock: ffff98fe7d015600/0x8e1c8a3488e64b91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b98 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229166.226369:0:14190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.122@tcp lock: ffff98fe7d015600/0x8e1c8a3488e64b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8e1c8a3488e64b98 expref: -99 pid: 14190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229166.590860:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782229166.716902:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782229166.716936:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782229166.717050:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229166.720139:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329516544 00000100:00100000:0.0:1782229166.720160:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329516544 00000100:00100000:0.0:1782229166.720289:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782229166.720301:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329516544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782229166.720359:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782229166.720493:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329516544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229166.720501:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782229166.720812:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329516544:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782229166.720863:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782229167.180773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229167.180818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229167.180847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229167.180853:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603840 00000100:00100000:0.0:1782229167.180868:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603840 00000100:00100000:1.0:1782229167.180899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229167.180950:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:0.0:1782229167.180964:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+6:2371:x1868802309603840:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229167.181183:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+6:2371:x1868802309603840:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 222us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229167.181193:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:3.0:1782229167.181204:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309604096 00000100:00100000:3.0:1782229167.181222:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309604096 00000100:00100000:3.0:1782229167.181263:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309604352 00000100:00100000:3.0:1782229167.181266:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309604352 00000100:00100000:3.0:1782229167.181292:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:3.0:1782229167.181301:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1f693db6-2191-4110-8410-5abdf5d0b559+5:2371:x1868802309604096:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229167.181335:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:2.0:1782229167.181348:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2371:x1868802309604352:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:2.0:1782229167.181387:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2371:x1868802309604352:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229167.181394:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00080000:2.0:1782229167.181418:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782229167.181423:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782229167.181426:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229167.181561:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1f693db6-2191-4110-8410-5abdf5d0b559+5:2371:x1868802309604096:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 260us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229167.181568:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:0.0:1782229167.182112:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603712 00000100:00100000:0.0:1782229167.182120:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603712 00000100:00100000:0.0:1782229167.182170:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 119 00000100:00100000:0.0:1782229167.182178:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2371:x1868802309603712:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229167.182209:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2371:x1868802309603712:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 33us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229167.182215:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 119 00000100:00100000:1.0:1782229167.183532:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229167.183579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229167.183620:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229167.183688:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309603968 00000100:00100000:0.0:1782229167.183698:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309603968 00000100:00100000:0.0:1782229167.183760:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309604480 00000100:00100000:0.0:1782229167.183763:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309604480 00000100:00100000:0.0:1782229167.183789:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:0.0:1782229167.183798:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+5:2371:x1868802309603968:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229167.183877:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+5:2371:x1868802309603968:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 80us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229167.183885:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:0.0:1782229167.183900:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:0.0:1782229167.183907:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2371:x1868802309604480:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229167.183932:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2371:x1868802309604480:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229167.183939:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:3.0:1782229167.184215:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309604224 00000100:00100000:3.0:1782229167.184298:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309604224 00000100:00100000:3.0:1782229167.184349:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:3.0:1782229167.184357:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2371:x1868802309604224:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229167.184399:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2371:x1868802309604224:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 43us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229167.184405:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00080000:1.0:1782229167.186071:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782229167.186084:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782229167.186087:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782229167.611737:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782229168.636012:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229168.749300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229168.749473:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309604608 00000100:00100000:2.0:1782229168.749483:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309604608 00000100:00100000:2.0:1782229168.749543:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:2.0:1782229168.749553:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+6:14405:x1868802309604608:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229168.749573:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229168.749594:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64b9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949ba9 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.749659:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.749674:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.749686:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.749700:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.749707:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.749731:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750404:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030000/0x8e1c8a3488e64bb4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750415:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030000/0x8e1c8a3488e64bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750423:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030000/0x8e1c8a3488e64bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229168.750527:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782229168.750532:0:14194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229168.750622:0:14194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030000/0x8e1c8a3488e64bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750635:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750641:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750647:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750652:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229168.750656:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750663:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750681:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:2.0:1782229168.750684:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229168.750689:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750695:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750708:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750715:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750721:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750726:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229168.750729:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750735:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750742:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98fe43930800) 00010000:00010000:2.0:1782229168.750744:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229168.750747:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750752:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750863:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64b9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ba9 expref: 8 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750879:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030000/0x8e1c8a3488e64bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949ba9 expref: 7 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.750887:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98fe43930400) 00010000:00010000:2.0:1782229168.750890:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229168.750892:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030000, rc 0) 00000100:00100000:2.0:1782229168.751873:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+7:14405:x1868802309604608:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 2315us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229168.751883:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:3.0:1782229168.779327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229168.780399:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309604864 00000100:00100000:2.0:1782229168.780414:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309604864 00000100:00100000:2.0:1782229168.780510:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:2.0:1782229168.780520:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+7:14405:x1868802309604864:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229168.780540:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229168.780560:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64bbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bb0 expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.780635:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.780650:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.780660:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.780694:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.780703:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.780710:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781184:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e64bd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781191:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e64bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781196:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e64bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229168.781204:0:14195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1782229168.781488:0:14195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781496:0:14195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781503:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781509:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229168.781514:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781537:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781550:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98fe43930400) 00010000:00010000:2.0:1782229168.781552:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229168.781557:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781563:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bc2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781580:0:14195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781585:0:14195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781591:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781595:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229168.781598:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781604:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781610:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98fe43930800) 00010000:00010000:2.0:1782229168.781613:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229168.781615:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.781631:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64bc9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.782007:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64bbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bb0 expref: 10 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.782024:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031600/0x8e1c8a3488e64bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bb0 expref: 9 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.782031:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe43930700) 00010000:00010000:2.0:1782229168.782034:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229168.782036:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031600, rc 0) 00000100:00100000:2.0:1782229168.782097:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+9:14405:x1868802309604864:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 1577us (2778us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1782229168.782104:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:0.0:1782229168.801596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229168.801697:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309604992 00000100:00100000:2.0:1782229168.801707:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309604992 00000100:00100000:2.0:1782229168.801776:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:2.0:1782229168.801786:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+9:14405:x1868802309604992:12345-192.168.204.22@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782229168.802024:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+9:14405:x1868802309604992:12345-192.168.204.22@tcp:59:lhsmtool_posix.0 Request processed in 237us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229168.802033:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:1.0:1782229168.900733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229168.900877:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309605120 00000100:00100000:2.0:1782229168.900893:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309605120 00000100:00100000:2.0:1782229168.900994:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:2.0:1782229168.901005:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+9:14411:x1868802309605120:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229168.901027:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229168.901059:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bb7 expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.901153:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.901168:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.901178:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.901192:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.901199:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.901206:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901819:0:14195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901828:0:14195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901835:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901842:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229168.901846:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901854:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901870:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:3.0:1782229168.901873:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229168.901878:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901884:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64be5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901897:0:14195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901903:0:14195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901914:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901919:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229168.901922:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901928:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901936:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98fe43930800) 00010000:00010000:3.0:1782229168.901938:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229168.901942:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.901947:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.902040:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64bde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bb7 expref: 10 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.902051:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:3.0:1782229168.902054:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229168.902057:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bb7 expref: 10 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.902066:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031a00, rc 0) 00000100:00100000:3.0:1782229168.902181:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+9:14411:x1868802309605120:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 1177us (1463us total) trans 0 rc 301/301 00000100:00100000:3.0:1782229168.902198:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:0.0:1782229168.919622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229168.921940:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309605248 00000100:00100000:1.0:1782229168.921956:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309605248 00000100:00100000:1.0:1782229168.922033:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:1.0:1782229168.922044:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1f693db6-2191-4110-8410-5abdf5d0b559+9:14411:x1868802309605248:12345-192.168.204.22@tcp:700:lfs.0 00000100:00100000:1.0:1782229168.922146:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1f693db6-2191-4110-8410-5abdf5d0b559+9:14411:x1868802309605248:12345-192.168.204.22@tcp:700:lfs.0 Request processed in 102us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229168.922154:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:0.0:1782229168.928710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229168.928828:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309605504 00000100:00100000:2.0:1782229168.928841:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309605504 00000100:00100000:2.0:1782229168.928902:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:2.0:1782229168.928912:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+9:14411:x1868802309605504:12345-192.168.204.22@tcp:36:lfs.0 00010000:00010000:2.0:1782229168.928972:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229168.929010:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64b21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b32 expref: 9 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.929034:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:2.0:1782229168.929044:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229168.929571:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.929587:0:14194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 5 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.929597:0:14194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.929633:0:14194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 5 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.929649:0:14194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 5 pid: 14195 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229168.929666:0:14194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14194:1868802329516672:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229168.930170:0:14194:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ed9300 going to sleep for 11 seconds 00000100:00100000:0.0:1782229168.937304:0:14194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14194:1868802329516672:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229168.937389:0:14194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229168.942761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229168.942856:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309605632 00000100:00100000:3.0:1782229168.942867:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309605632 00010000:00010000:3.0:1782229168.942908:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 6 pid: 14195 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229168.942949:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:3.0:1782229168.942959:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:2373:x1868802309605632:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229168.942975:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229168.942991:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 6 pid: 14195 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.943006:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 6 pid: 14195 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.943030:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64b59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949b94 expref: 6 pid: 14195 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.943050:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:3.0:1782229168.943055:0:14180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.943065:0:14180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.943073:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229168.943126:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229168.943192:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309605632:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 234us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229168.943200:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00010000:00010000:2.0:1782229168.943387:0:14194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.943396:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.943420:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.943467:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.943476:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229168.944805:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782229168.944820:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.944828:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.944834:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.944839:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229168.944842:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.944848:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.944860:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe43930c00) 00010000:00010000:2.0:1782229168.944863:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229168.944866:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229168.944871:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64bf3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782229168.944887:0:14194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e8b7175 reply state 000000008ddd93f4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229168.944896:0:14194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782229168.945002:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+10:14411:x1868802309605504:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 16088us (16301us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782229168.945019:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00010000:00010000:1.0:1782229168.954584:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229168.954605:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229168.954614:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229168.954621:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229168.954626:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229168.954634:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229168.954837:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98fe43930000) 00010000:00010000:1.0:1782229168.954840:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229168.954844:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229168.954848:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64bfa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782229169.022075:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782229169.079521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229169.079626:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309605760 00000100:00100000:0.0:1782229169.079636:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309605760 00000100:00100000:0.0:1782229169.079716:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:0.0:1782229169.079729:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+9:14419:x1868802309605760:12345-192.168.204.22@tcp:101:lctl.0 00010000:00010000:0.0:1782229169.079753:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229169.079778:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bbe expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.079845:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64c08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.079859:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.079872:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229169.079931:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782229169.079936:0:14193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229169.079975:0:14193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.080010:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bbe expref: 11 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.080043:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23000/0x8e1c8a3488e64c08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bbe expref: 10 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.080051:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229169.080055:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229169.080058:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23000, rc 0) 00000100:00100000:0.0:1782229169.080126:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+10:14419:x1868802309605760:12345-192.168.204.22@tcp:101:lctl.0 Request processed in 400us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229169.080133:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00080000:1.0:1782229169.080412:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229169.123173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.123286:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309605888 00000100:00100000:3.0:1782229169.123297:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309605888 00000100:00100000:3.0:1782229169.123379:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00080000:1.0:1782229169.123386:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782229169.123389:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:14420:x1868802309605888:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229169.123407:0:15355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229169.123427:0:15355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bc5 expref: -99 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.123522:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64c16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.123535:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.123546:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229169.123606:0:15355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782229169.123610:0:15355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229169.123635:0:15355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.123659:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bc5 expref: 7 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.123699:0:15355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917a00/0x8e1c8a3488e64c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bc5 expref: 6 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.123708:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:3.0:1782229169.123711:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782229169.123715:0:15355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917a00, rc 0) 00000100:00100000:3.0:1782229169.123898:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:14420:x1868802309605888:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 510us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229169.123906:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 21 00000100:00100000:2.0:1782229169.151517:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229169.151705:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309606016 00000100:00100000:0.0:1782229169.151718:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309606016 00000100:00100000:0.0:1782229169.151811:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:0.0:1782229169.151825:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+6:14420:x1868802309606016:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:0.0:1782229169.151852:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229169.151880:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bcc expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.151968:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.151997:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152012:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152057:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152066:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152073:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152223:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64c32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152243:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152251:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229169.152303:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782229169.152308:0:14193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229169.152341:0:14193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64c32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152354:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152361:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152369:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152385:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229169.152391:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152400:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152418:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:0.0:1782229169.152421:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229169.152426:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152472:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23c00/0x8e1c8a3488e64c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152489:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152495:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152502:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152507:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229169.152510:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152517:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152535:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98fe42cb9500) 00010000:00010000:0.0:1782229169.152537:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229169.152540:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152546:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64c2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152584:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bcc expref: 8 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152599:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64c32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bcc expref: 7 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.152606:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:0.0:1782229169.152609:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782229169.152611:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23e00, rc 0) 00000100:00100000:0.0:1782229169.152707:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe50c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+7:14420:x1868802309606016:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 885us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229169.152716:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 22 00000100:00100000:1.0:1782229169.164837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.165702:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309606272 00000100:00100000:2.0:1782229169.165713:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309606272 00000100:00100000:2.0:1782229169.165851:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:2.0:1782229169.165861:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+7:14420:x1868802309606272:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229169.165882:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229169.165901:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bd3 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229169.166024:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782229169.166140:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bd3 expref: 9 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.166156:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229169.166159:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229169.166164:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bd3 expref: 9 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.166178:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031800, rc 0) 00000100:00100000:2.0:1782229169.166243:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe446aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+8:14420:x1868802309606272:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 384us (1415us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1782229169.166250:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 23 00000100:00100000:1.0:1782229169.171905:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229169.172000:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309606528 00000100:00100000:0.0:1782229169.172009:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309606528 00000100:00100000:0.0:1782229169.172078:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 24 00000100:00100000:0.0:1782229169.172088:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+8:14420:x1868802309606528:12345-192.168.204.22@tcp:36:lfs.0 00010000:00010000:0.0:1782229169.172152:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782229169.172189:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64c32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bcc expref: 8 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.172226:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:0.0:1782229169.172236:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229169.172259:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.172270:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.172280:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782229169.172540:0:14193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012745f54 reply state 00000000d0c8cabc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229169.172548:0:14193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782229169.173112:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1782229169.173347:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+9:14420:x1868802309606528:12345-192.168.204.22@tcp:36:lfs.0 Request processed in 1259us (1451us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1782229169.173355:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 24 00010000:00010000:3.0:1782229169.182473:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.182493:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.182501:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.182507:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229169.182512:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.182519:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.182535:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe42cb9500) 00010000:00010000:3.0:1782229169.182539:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782229169.182543:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.182739:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64c47 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229169.183191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.183322:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309606784 00000100:00100000:3.0:1782229169.183331:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309606784 00000100:00100000:3.0:1782229169.183508:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:3.0:1782229169.183519:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+8:14420:x1868802309606784:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229169.183905:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+9:14420:x1868802309606784:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 387us (881us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782229169.183913:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:1.0:1782229169.192606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.193058:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309607040 00000100:00100000:2.0:1782229169.193068:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309607040 00000100:00100000:2.0:1782229169.193124:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:2.0:1782229169.193133:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+9:14420:x1868802309607040:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229169.193171:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229169.193192:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bda expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193262:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193276:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193286:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193300:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193306:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193313:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229169.193478:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782229169.193584:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193592:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193599:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193613:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229169.193617:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193626:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193638:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229169.193641:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229169.193647:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193653:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64c55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193667:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193673:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193678:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193683:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229169.193687:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193693:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193710:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98fe43930c00) 00010000:00010000:2.0:1782229169.193713:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229169.193716:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193723:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193758:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bda expref: 11 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193769:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229169.193771:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229169.193775:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bda expref: 11 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.193783:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031800, rc 0) 00000100:00100000:2.0:1782229169.193859:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+10:14420:x1868802309607040:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 727us (1263us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1782229169.193867:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 25 00000100:00100000:1.0:1782229169.197887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.197987:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309607168 00000100:00100000:3.0:1782229169.197998:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309607168 00000100:00100000:3.0:1782229169.198101:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:3.0:1782229169.198111:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+10:14420:x1868802309607168:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229169.198134:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229169.198155:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64c6a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949be1 expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.198269:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.198283:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.198294:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229169.198344:0:14195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782229169.198361:0:14195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782229169.198390:0:14195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.198421:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64c6a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 12 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.198476:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 11 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.198485:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:3.0:1782229169.198489:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782229169.198493:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916a00, rc 0) 00000100:00100000:3.0:1782229169.198543:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+11:14420:x1868802309607168:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 433us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229169.198754:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 26 00000100:00100000:1.0:1782229169.204398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.204525:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309607296 00000100:00100000:2.0:1782229169.204535:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309607296 00000100:00100000:2.0:1782229169.204595:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:2.0:1782229169.204605:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+11:14420:x1868802309607296:12345-192.168.204.22@tcp:37:lfs.0 00000100:00100000:0.0:1782229169.209151:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+11:14420:x1868802309607296:12345-192.168.204.22@tcp:37:lfs.0 Request processed in 4536us (4754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229169.209182:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 3 00000100:00100000:0.0:1782229169.214801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.214947:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309607552 00000100:00100000:3.0:1782229169.214959:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309607552 00000100:00100000:3.0:1782229169.215027:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:3.0:1782229169.215039:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77959050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+11:14420:x1868802309607552:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:2.0:1782229169.216031:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77959050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+12:14420:x1868802309607552:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 990us (1237us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1782229169.216041:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 4 00000100:00100000:1.0:1782229169.295866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.295943:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309607680 00000100:00100000:3.0:1782229169.295951:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309607680 00000100:00100000:3.0:1782229169.296033:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:3.0:1782229169.296047:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+10:14426:x1868802309607680:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229169.296069:0:15355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229169.296089:0:15355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949be8 expref: -99 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296168:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296181:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296191:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296205:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296212:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296219:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296547:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051000/0x8e1c8a3488e64c8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296554:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051000/0x8e1c8a3488e64c8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.296559:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051000/0x8e1c8a3488e64c8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229169.296913:0:15355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782229169.296917:0:15355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229169.296955:0:15355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051000/0x8e1c8a3488e64c8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.296965:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.296969:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.296985:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.296990:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229169.296994:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297001:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297010:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229169.297012:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229169.297016:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297020:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64c7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297030:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297034:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297044:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297047:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229169.297049:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297055:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297063:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98fe43933400) 00010000:00010000:2.0:1782229169.297065:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229169.297068:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297073:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64c86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297106:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be8 expref: 12 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297119:0:15355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051000/0x8e1c8a3488e64c8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be8 expref: 11 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.297126:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:2.0:1782229169.297127:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782229169.297129:0:15355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051000, rc 0) 00000100:00100000:2.0:1782229169.297228:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+11:14426:x1868802309607680:12345-192.168.204.22@tcp:101:bash.0 Request processed in 1185us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229169.297401:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:1.0:1782229169.302419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.304009:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309607936 00000100:00100000:2.0:1782229169.304023:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309607936 00000100:00100000:2.0:1782229169.304098:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 28 00000100:00100000:2.0:1782229169.304109:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+11:14426:x1868802309607936:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229169.304130:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229169.304150:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c94 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bef expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.304284:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.304299:0:14193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 11 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.304308:0:14193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.304344:0:14193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 11 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.304360:0:14193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 11 pid: 14195 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229169.304374:0:14193:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14193:1868802329516800:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229169.304509:0:14193:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe662e7180 going to sleep for 11 seconds 00000100:00100000:0.0:1782229169.307568:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229169.307677:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309608064 00000100:00100000:1.0:1782229169.307687:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309608064 00010000:00010000:1.0:1782229169.307726:0:14179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 12 pid: 14195 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229169.307773:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:1.0:1782229169.307784:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+12:2373:x1868802309608064:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229169.307815:0:14179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229169.307822:0:14179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 12 pid: 14195 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.307848:0:14179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 12 pid: 14195 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.307877:0:14179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:1.0:1782229169.307898:0:14179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.307908:0:14179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.307917:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.307937:0:14179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229169.308006:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+12:2373:x1868802309608064:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 223us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229169.308014:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00010000:00010000:2.0:1782229169.309599:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64c71 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949be1 expref: 11 pid: 14195 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229169.309630:0:14193:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14193:1868802329516800:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229169.309654:0:14193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.309664:0:14193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.309670:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.309692:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.309703:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.309711:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310552:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310563:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310571:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229169.310583:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782229169.310609:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310622:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310629:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310635:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229169.310640:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310648:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310660:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:2.0:1782229169.310663:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229169.310666:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310671:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64c9b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782229169.310683:0:14193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000abdf623f reply state 000000006b10d1a9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229169.310691:0:14193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782229169.310724:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64c94 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 14 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310737:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 13 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.310755:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:2.0:1782229169.310758:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1782229169.310760:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40030600, rc 0) 00000100:00100000:2.0:1782229169.310828:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+14:14426:x1868802309607936:12345-192.168.204.22@tcp:101:bash.0 Request processed in 6720us (8420us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1782229169.310836:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 28 00010000:00010000:1.0:1782229169.317618:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.317633:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.317638:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.317643:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:1.0:1782229169.317647:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.317652:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.317665:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98fe43930c00) 00010000:00010000:1.0:1782229169.317667:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782229169.317683:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.317687:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ca2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229169.341294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.342131:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309608192 00000100:00100000:2.0:1782229169.342143:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309608192 00000100:00100000:2.0:1782229169.342212:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 29 00000100:00100000:2.0:1782229169.342222:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+13:14426:x1868802309608192:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229169.342248:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229169.342269:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64cb7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bf6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.342335:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64cbe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.342350:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64cbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.342361:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64cbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229169.342399:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782229169.342403:0:14194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229169.342421:0:14194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64cbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.342542:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64cbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.342567:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64cb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bf6 expref: 15 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.342588:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64cbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bf6 expref: 14 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.342596:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:2.0:1782229169.342599:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229169.342607:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031400, rc 0) 00000100:00100000:2.0:1782229169.342718:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+14:14426:x1868802309608192:12345-192.168.204.22@tcp:101:bash.0 Request processed in 496us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229169.342725:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 29 00000100:00100000:0.0:1782229169.351929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.352059:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309608448 00000100:00100000:3.0:1782229169.352070:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309608448 00000100:00100000:3.0:1782229169.352132:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:3.0:1782229169.352143:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1f693db6-2191-4110-8410-5abdf5d0b559+14:14426:x1868802309608448:12345-192.168.204.22@tcp:35:bash.0 00000100:00100000:3.0:1782229169.352559:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1f693db6-2191-4110-8410-5abdf5d0b559+15:14426:x1868802309608448:12345-192.168.204.22@tcp:35:bash.0 Request processed in 417us (641us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1782229169.352568:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 5 00000100:00100000:1.0:1782229169.467747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.467843:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309608704 00000100:00100000:3.0:1782229169.467852:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309608704 00000100:00100000:3.0:1782229169.468118:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:3.0:1782229169.468129:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+15:14436:x1868802309608704:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:3.0:1782229169.468153:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229169.468174:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051200/0x8e1c8a3488e64cc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949bfd expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782229169.468410:0:14195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782229169.468586:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051200/0x8e1c8a3488e64cc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bfd expref: 17 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.468601:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:3.0:1782229169.468604:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782229169.468609:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051200/0x8e1c8a3488e64cc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bfd expref: 17 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.468623:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051200, rc 0) 00000100:00100000:3.0:1782229169.468679:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+16:14436:x1868802309608704:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 551us (942us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1782229169.468687:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 30 00000100:00100000:1.0:1782229169.473600:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229169.473700:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309608960 00000100:00100000:3.0:1782229169.473710:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309608960 00000100:00100000:3.0:1782229169.473812:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:3.0:1782229169.473839:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1f693db6-2191-4110-8410-5abdf5d0b559+16:14436:x1868802309608960:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:3.0:1782229169.474125:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1f693db6-2191-4110-8410-5abdf5d0b559+17:14436:x1868802309608960:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 287us (703us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1782229169.474134:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 6 00000100:00100000:0.0:1782229169.558047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.558416:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309609216 00000100:00100000:2.0:1782229169.558476:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309609216 00000100:00100000:2.0:1782229169.558558:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 31 00000100:00100000:2.0:1782229169.558572:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+17:14439:x1868802309609216:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229169.558608:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229169.558637:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64cd3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c04 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.559031:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64cda lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.559049:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64cda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.559086:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64cda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229169.559102:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782229169.560115:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031800/0x8e1c8a3488e64cd3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c04 expref: 20 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.560149:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64cda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c04 expref: 19 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.560161:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:2.0:1782229169.560164:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229169.560295:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe40031a00, rc 0) 00000100:00100000:2.0:1782229169.560837:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+19:14439:x1868802309609216:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 2265us (2804us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1782229169.560848:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 31 00000100:00100000:1.0:1782229169.566515:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229169.566558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.566660:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309609344 00000100:00100000:2.0:1782229169.566684:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309609344 00000100:00100000:2.0:1782229169.566775:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:2.0:1782229169.566789:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+19:14439:x1868802309609344:12345-192.168.204.22@tcp:54:lfs.0 00010000:00010000:2.0:1782229169.566903:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.566927:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.566944:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.567018:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.567025:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.567033:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.567039:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe40031e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229169.567045:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.567053:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.567070:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:2.0:1782229169.567074:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229169.567080:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229169.567086:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031e00/0x8e1c8a3488e64ce8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229169.567232:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+19:14439:x1868802309609344:12345-192.168.204.22@tcp:54:lfs.0 Request processed in 433us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229169.567243:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 32 00000100:00100000:3.0:1782229169.567772:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309609472 00000100:00100000:3.0:1782229169.567779:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309609472 00000100:00100000:3.0:1782229169.567835:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:3.0:1782229169.567845:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+19:2371:x1868802309609472:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229169.567860:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229169.567881:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031a00/0x8e1c8a3488e64cda lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c04 expref: 19 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229169.567897:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:3.0:1782229169.567901:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229169.567944:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+18:2371:x1868802309609472:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 101us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229169.567951:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:1.0:1782229169.574839:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.574994:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309609728 00000100:00100000:2.0:1782229169.575010:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309609728 00000100:00100000:2.0:1782229169.575086:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 7 00000100:00100000:2.0:1782229169.575114:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+18:14439:x1868802309609728:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:2.0:1782229169.575488:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+19:14439:x1868802309609728:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 377us (662us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1782229169.575497:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 7 00010000:00010000:3.0:1782229169.661119:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229169.790559:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782229169.790592:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229169.790689:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229169.790821:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329516928 00000100:00100000:2.0:1782229169.790833:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329516928 00000100:00100000:2.0:1782229169.790913:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782229169.790936:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329516928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782229169.790994:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229169.791051:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868802329516928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229169.791059:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1782229169.791652:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782229169.791707:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1868802329516928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782229169.792007:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329517184:0@lo:400:kworker.0 00000100:00100000:3.0:1782229169.792074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229169.792105:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329517056:0@lo:400:kworker.0 00000100:00100000:0.0:1782229169.792167:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229169.792204:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329517568:0@lo:400:kworker.0 00000100:00100000:0.0:1782229169.792234:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229169.792275:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329517440:0@lo:400:kworker.0 00000100:00100000:0.0:1782229169.792306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229169.792326:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782229169.792333:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe7bf11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329517312:0@lo:400:kworker.0 00000100:00100000:2.0:1782229169.792345:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329517184 00000100:00100000:2.0:1782229169.792352:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329517184 00000100:00100000:0.0:1782229169.792357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229169.792392:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329517568 00000100:00100000:0.0:1782229169.792396:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329517568 00000100:00100000:2.0:1782229169.792412:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782229169.792424:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329517184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229169.792458:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329517440 00000100:00100000:0.0:1782229169.792461:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329517440 00000100:00100000:0.0:1782229169.792478:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329517312 00000100:00100000:0.0:1782229169.792481:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329517312 00000100:00100000:0.0:1782229169.792498:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782229169.792505:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329517568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229169.792513:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1868802329517184:12345-0@lo:400:kworker.0 Request processed in 90us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229169.792522:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782229169.792551:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1868802329517568:12345-0@lo:400:kworker.0 Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229169.792555:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782229169.792565:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782229169.792569:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329517440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229169.792584:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782229169.792592:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329517312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229169.792615:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868802329517440:12345-0@lo:400:kworker.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229169.792622:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782229169.792631:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1868802329517312:12345-0@lo:400:kworker.0 Request processed in 38us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229169.792637:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782229169.792669:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe7bf11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1868802329517312:0@lo:400:kworker.0 00000100:00100000:0.0:1782229169.792679:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1868802329517440:0@lo:400:kworker.0 00000100:00100000:0.0:1782229169.792716:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1868802329517568:0@lo:400:kworker.0 00000100:00080000:0.0:1782229169.792753:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782229169.792758:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229169.792876:0:14187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329517056 00000100:00100000:3.0:1782229169.792881:0:14187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329517056 00000100:00100000:3.0:1782229169.792917:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782229169.792936:0:14187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3310:x1868802329517056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782229169.792976:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329517184:0@lo:400:kworker.0 00000100:00100000:3.0:1782229169.792990:0:14187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3310:x1868802329517056:12345-0@lo:400:kworker.0 Request processed in 64us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229169.793008:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782229169.802016:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe50c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3310:1868802329517056:0@lo:400:kworker.0 00000100:00100000:2.0:1782229169.911617:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229169.912046:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309609984 00000100:00100000:0.0:1782229169.912061:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309609984 00000100:00100000:0.0:1782229169.912153:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:0.0:1782229169.912167:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+19:14470:x1868802309609984:12345-192.168.204.22@tcp:101:cat.0 00010000:00010000:0.0:1782229169.912202:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229169.912230:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64cef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c0b expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.912370:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64cf6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.912388:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.912402:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229169.912417:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782229169.912648:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64cef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c0b expref: 22 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.912671:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c0b expref: 21 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229169.912708:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:0.0:1782229169.912711:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229169.912716:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23e00, rc 0) 00000100:00100000:0.0:1782229169.912814:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+21:14470:x1868802309609984:12345-192.168.204.22@tcp:101:cat.0 Request processed in 649us (1213us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1782229169.912821:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 33 00000100:00100000:0.0:1782229169.922148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229169.922204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229169.922219:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309610240 00000100:00100000:2.0:1782229169.922235:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309610240 00000100:00100000:2.0:1782229169.922323:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:2.0:1782229169.922335:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+21:14470:x1868802309610240:12345-192.168.204.22@tcp:35:cat.0 00000100:00100000:1.0:1782229169.922392:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309610368 00000100:00100000:1.0:1782229169.922397:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309610368 00000100:00100000:1.0:1782229169.922476:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:1.0:1782229169.922486:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f693db6-2191-4110-8410-5abdf5d0b559+22:2370:x1868802309610368:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229169.922503:0:14179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229169.922537:0:14179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23e00/0x8e1c8a3488e64cf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c0b expref: 22 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229169.922563:0:14179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:1.0:1782229169.922570:0:14179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229169.922655:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f693db6-2191-4110-8410-5abdf5d0b559+22:2370:x1868802309610368:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 170us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229169.922686:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 1 00000100:00100000:2.0:1782229169.922794:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+21:14470:x1868802309610240:12345-192.168.204.22@tcp:35:cat.0 Request processed in 460us (662us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1782229169.922801:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 8 00000100:00100000:1.0:1782229170.036551:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229170.036663:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309610624 00000100:00100000:0.0:1782229170.036675:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309610624 00000100:00100000:0.0:1782229170.036766:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:0.0:1782229170.036778:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+21:14476:x1868802309610624:12345-192.168.204.22@tcp:101:dd.0 00010000:00010000:0.0:1782229170.036813:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229170.036850:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d04 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c12 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.036998:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.037015:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.037032:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229170.037047:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782229170.037228:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d04 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c12 expref: 24 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.037279:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c12 expref: 23 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.037290:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:0.0:1782229170.037293:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229170.037297:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22a00, rc 0) 00000100:00100000:0.0:1782229170.037384:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+23:14476:x1868802309610624:12345-192.168.204.22@tcp:101:dd.0 Request processed in 608us (847us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1782229170.037392:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 34 00000100:00100000:1.0:1782229170.050030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229170.050146:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309610880 00000100:00100000:0.0:1782229170.050161:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309610880 00000100:00100000:0.0:1782229170.050241:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 35 00000100:00100000:0.0:1782229170.050253:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+23:14476:x1868802309610880:12345-192.168.204.22@tcp:36:dd.0 00010000:00010000:0.0:1782229170.050331:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782229170.050366:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c12 expref: 23 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.050392:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40031400/0x8e1c8a3488e64cbe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bf6 expref: 22 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.050404:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:0.0:1782229170.050411:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229170.050769:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.050791:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.050835:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782229170.050901:0:14194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1782229170.050947:0:14194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc9d1bd7 reply state 0000000085a82e5c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229170.050970:0:14194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229170.051100:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+24:14476:x1868802309610880:12345-192.168.204.22@tcp:36:dd.0 Request processed in 848us (1083us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1782229170.051109:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 35 00000020:00080000:0.0:1782229170.051115:0:14194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229170.058319:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.058347:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.058356:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.058364:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229170.058370:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.058379:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.058402:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:3.0:1782229170.058406:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229170.058413:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.058420:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22000/0x8e1c8a3488e64d19 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229170.195366:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229170.195583:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309611136 00000100:00100000:2.0:1782229170.195598:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309611136 00000100:00100000:2.0:1782229170.195671:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:2.0:1782229170.195685:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+23:14476:x1868802309611136:12345-192.168.204.22@tcp:35:dd.0 00000100:00100000:2.0:1782229170.196043:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+24:14476:x1868802309611136:12345-192.168.204.22@tcp:35:dd.0 Request processed in 359us (695us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1782229170.196053:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 9 00000100:00100000:1.0:1782229170.420243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229170.420376:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309611264 00000100:00100000:0.0:1782229170.420390:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309611264 00000100:00100000:0.0:1782229170.420505:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:0.0:1782229170.420528:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+24:14490:x1868802309611264:12345-192.168.204.22@tcp:101:stat.0 00010000:00010000:0.0:1782229170.420563:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229170.420590:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d20 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c19 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.420791:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.420810:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.420824:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.420866:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.420874:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.420881:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421032:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64d35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421041:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421049:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229170.421099:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782229170.421103:0:14193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229170.421146:0:14193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421161:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421171:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421177:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421199:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421206:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229170.421210:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421219:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421235:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:0.0:1782229170.421238:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229170.421244:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421251:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d27 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421268:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421275:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421282:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421287:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229170.421290:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421306:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421315:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98fe42cb9400) 00010000:00010000:0.0:1782229170.421317:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229170.421320:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421326:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421367:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d20 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c19 expref: 26 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421384:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64d35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c19 expref: 25 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.421391:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:0.0:1782229170.421394:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229170.421397:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23a00, rc 0) 00000100:00100000:0.0:1782229170.421779:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+25:14490:x1868802309611264:12345-192.168.204.22@tcp:101:stat.0 Request processed in 1261us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229170.421788:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 36 00000100:00100000:1.0:1782229170.515106:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229170.515242:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309611520 00000100:00100000:2.0:1782229170.515255:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309611520 00000100:00100000:2.0:1782229170.515344:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 37 00000100:00100000:2.0:1782229170.515358:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+25:14496:x1868802309611520:12345-192.168.204.22@tcp:36:truncate.0 00010000:00010000:2.0:1782229170.515483:0:15355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229170.515531:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23a00/0x8e1c8a3488e64d35 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c19 expref: 25 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229170.515557:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:2.0:1782229170.515563:0:15355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229170.515875:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229170.515892:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229170.515904:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782229170.515979:0:15355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1782229170.516010:0:15355:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000691464d5 reply state 00000000dfadb0f5 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229170.516020:0:15355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782229170.516170:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+27:14496:x1868802309611520:12345-192.168.204.22@tcp:36:truncate.0 Request processed in 813us (1078us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1782229170.516179:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 37 00000020:00080000:2.0:1782229170.516185:0:15355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229170.523523:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.523548:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.523557:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.523589:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229170.523596:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.523604:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.523627:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:3.0:1782229170.523631:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229170.523637:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.523644:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64d3c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229170.683853:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229170.751057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229170.751186:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309611648 00000100:00100000:0.0:1782229170.751205:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309611648 00000100:00100000:0.0:1782229170.751300:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:0.0:1782229170.751314:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+26:14510:x1868802309611648:12345-192.168.204.22@tcp:101:stat.0 00010000:00010000:0.0:1782229170.751371:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229170.751402:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c20 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751589:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751608:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751622:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751637:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751644:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751651:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751775:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751797:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751803:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229170.751848:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1782229170.751860:0:14193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229170.751883:0:14193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751896:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751906:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751913:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751919:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751931:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229170.751935:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751953:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751966:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:0.0:1782229170.751970:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229170.751976:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751983:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.751997:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752013:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752018:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752023:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22200 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229170.752025:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752032:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752039:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98fe42cb9400) 00010000:00010000:0.0:1782229170.752041:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229170.752044:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752049:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752087:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 28 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752102:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 27 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.752108:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:0.0:1782229170.752111:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782229170.752120:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e23400, rc 0) 00000100:00100000:0.0:1782229170.752216:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+27:14510:x1868802309611648:12345-192.168.204.22@tcp:101:stat.0 Request processed in 905us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229170.752226:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 38 00000100:00100000:1.0:1782229170.895242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229170.895332:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309611904 00000100:00100000:2.0:1782229170.895341:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309611904 00000100:00100000:2.0:1782229170.895399:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:2.0:1782229170.895411:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+27:14520:x1868802309611904:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229170.895458:0:15355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229170.895479:0:15355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c27 expref: -99 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229170.895611:0:15355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782229170.895731:0:15355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c27 expref: 29 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229170.895759:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229170.895762:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229170.895768:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c27 expref: 29 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229170.895783:0:15355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916800, rc 0) 00000100:00100000:2.0:1782229170.895840:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+28:14520:x1868802309611904:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 433us (672us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1782229170.895848:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 39 00000100:00100000:1.0:1782229170.902531:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229170.902629:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309612160 00000100:00100000:2.0:1782229170.902639:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309612160 00000100:00100000:2.0:1782229170.902687:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:2.0:1782229170.902697:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe6dd16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+28:14520:x1868802309612160:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:2.0:1782229170.902977:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe6dd16c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+29:14520:x1868802309612160:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 280us (456us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1782229170.902986:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 10 00000100:00100000:1.0:1782229170.988746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229170.989386:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309612416 00000100:00100000:0.0:1782229170.989398:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309612416 00000100:00100000:0.0:1782229170.989487:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 40 00000100:00100000:0.0:1782229170.989499:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+29:14526:x1868802309612416:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:0.0:1782229170.989523:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782229170.989543:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d6d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c2e expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.989724:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.989742:0:14193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 30 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.989751:0:14193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 30 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.989759:0:14193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.989792:0:14193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 30 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.989808:0:14193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 30 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229170.989841:0:14193:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd43426300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14193:1868802329517696:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229170.990801:0:14193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 30 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.990815:0:14193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 30 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229170.990827:0:14193:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd43426d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14193:1868802329517824:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229170.990859:0:14193:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782229170.994496:0:14193:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd43426300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14193:1868802329517696:192.168.204.22@tcp:104: 00000100:00100000:0.0:1782229170.994514:0:14193:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd43426d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14193:1868802329517824:192.168.204.22@tcp:104: 00010000:00010000:0.0:1782229170.994541:0:14193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229170.997413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229170.997493:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229170.997579:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309612544 00000100:00100000:3.0:1782229170.997589:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309612544 00010000:00010000:3.0:1782229170.997629:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 31 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229170.997660:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309612672 00000100:00100000:3.0:1782229170.997663:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309612672 00010000:00010000:3.0:1782229170.997673:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 32 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229170.997692:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:3.0:1782229170.997699:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+32:2372:x1868802309612544:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229170.997715:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229170.997722:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 32 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.997747:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 32 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.997770:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe40030600/0x8e1c8a3488e64ca9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949bef expref: 32 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.997787:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:3.0:1782229170.997792:0:14180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.997801:0:14180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.997807:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229170.997858:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+31:2372:x1868802309612544:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 158us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229170.997865:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:3.0:1782229170.997911:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:3.0:1782229170.997929:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+30:2372:x1868802309612672:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229170.997952:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229170.997958:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 30 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.997970:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 30 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.997993:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23400/0x8e1c8a3488e64d58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c20 expref: 30 pid: 14193 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.998002:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:3.0:1782229170.998005:0:14180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.998013:0:14180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.998021:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229170.998043:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229170.998063:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+29:2372:x1868802309612672:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 147us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229170.998070:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00010000:00010000:0.0:1782229170.998378:0:14193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.998388:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229170.998409:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1782229170.999379:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22a00/0x8e1c8a3488e64d6d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 30 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.999408:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 29 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229170.999466:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:0.0:1782229170.999470:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782229170.999473:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe59e22200, rc 0) 00000100:00100000:0.0:1782229170.999559:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+29:14526:x1868802309612416:12345-192.168.204.22@tcp:101:bash.0 Request processed in 10060us (10821us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1782229170.999569:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 40 00000100:00100000:3.0:1782229171.002776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229171.002934:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309612928 00000100:00100000:2.0:1782229171.002954:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309612928 00000100:00100000:2.0:1782229171.003064:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 41 00000100:00100000:2.0:1782229171.003074:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+29:14526:x1868802309612928:12345-192.168.204.22@tcp:36:bash.0 00010000:00010000:2.0:1782229171.003344:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.003359:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.003386:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782229171.003469:0:15355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1782229171.003495:0:15355:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000756a8265 reply state 00000000963d287c transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229171.003504:0:15355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782229171.003597:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+32:14526:x1868802309612928:12345-192.168.204.22@tcp:36:bash.0 Request processed in 523us (829us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1782229171.003605:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 41 00000020:00080000:2.0:1782229171.003610:0:15355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782229171.008551:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.008569:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.008578:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.008585:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229171.008591:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.008617:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.008637:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:3.0:1782229171.008640:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229171.008645:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.008652:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d82 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229171.011812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229171.012568:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309613056 00000100:00100000:2.0:1782229171.012579:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309613056 00000100:00100000:2.0:1782229171.012696:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00100000:2.0:1782229171.012707:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+31:14526:x1868802309613056:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229171.012732:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229171.012753:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64d89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c35 expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.012810:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64d89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c35 expref: 32 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.012825:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64d89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c35 expref: 32 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.012846:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:2.0:1782229171.012863:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782229171.012867:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917c00, rc 0) 00000100:00100000:2.0:1782229171.012931:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+32:14526:x1868802309613056:12345-192.168.204.22@tcp:101:bash.0 Request processed in 226us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229171.012949:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 42 00000100:00080000:0.0:1782229171.015864:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782229171.041765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229171.041952:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309613184 00000100:00100000:2.0:1782229171.041963:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309613184 00000100:00100000:2.0:1782229171.042024:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:2.0:1782229171.042033:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+32:14526:x1868802309613184:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229171.042054:0:15355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229171.042074:0:15355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64d90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c3c expref: -99 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.042187:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.042203:0:15355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 33 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.042213:0:15355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.042247:0:15355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 33 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.042262:0:15355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 33 pid: 14193 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229171.042276:0:15355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15355:1868802329517952:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229171.042379:0:15355:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782229171.045304:0:15355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15355:1868802329517952:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229171.045336:0:15355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229171.047784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229171.047873:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309613312 00000100:00100000:3.0:1782229171.047882:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309613312 00010000:00010000:3.0:1782229171.047923:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 34 pid: 14193 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229171.047972:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:3.0:1782229171.047982:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+34:2372:x1868802309613312:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782229171.047997:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782229171.048005:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 34 pid: 14193 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.048021:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 34 pid: 14193 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.048042:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22200/0x8e1c8a3488e64d74 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c2e expref: 34 pid: 14193 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.048076:0:14180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:3.0:1782229171.048082:0:14180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.048103:0:14180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.048111:0:14180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.048148:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782229171.048210:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+33:2372:x1868802309613312:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 229us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229171.048217:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00010000:00010000:2.0:1782229171.050270:0:15355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.050286:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229171.050338:0:15355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782229171.050343:0:15355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229171.050364:0:15355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.050406:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64d90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c3c expref: 33 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.050425:0:15355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c3c expref: 32 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229171.050489:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:2.0:1782229171.050492:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782229171.050495:0:15355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916800, rc 0) 00000100:00100000:2.0:1782229171.050576:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+32:14526:x1868802309613184:12345-192.168.204.22@tcp:101:bash.0 Request processed in 8543us (8821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229171.050585:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 43 00000100:00100000:1.0:1782229171.056244:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229171.056348:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309613568 00000100:00100000:0.0:1782229171.056358:0:16214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309613568 00000100:00100000:0.0:1782229171.056417:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:0.0:1782229171.056427:0:16214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f693db6-2191-4110-8410-5abdf5d0b559+32:14526:x1868802309613568:12345-192.168.204.22@tcp:103:bash.0 00010000:00010000:0.0:1782229171.056479:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782229171.056504:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64d97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c3c expref: 32 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229171.056524:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64d89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c35 expref: 31 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229171.056534:0:16214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe43930f00) 00010000:00010000:0.0:1782229171.056545:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782229171.056592:0:16214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f693db6-2191-4110-8410-5abdf5d0b559+30:14526:x1868802309613568:12345-192.168.204.22@tcp:103:bash.0 Request processed in 166us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229171.056599:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 2 00000100:00100000:1.0:1782229171.071569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229171.071667:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309613696 00000100:00100000:0.0:1782229171.071679:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309613696 00000100:00100000:0.0:1782229171.071758:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:0.0:1782229171.071769:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+30:14526:x1868802309613696:12345-192.168.204.22@tcp:58:bash.0 00010000:00010000:0.0:1782229171.071866:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229171.071883:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229171.071894:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782229171.078766:0:14193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782229171.078914:0:14193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1782229171.078985:0:14193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1782229171.079111:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+30:14526:x1868802309613696:12345-192.168.204.22@tcp:58:bash.0 Request processed in 7338us (7546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229171.079123:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 44 00000100:00100000:1.0:1782229171.084418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229171.093327:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309613824 00000100:00100000:3.0:1782229171.093345:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309613824 00000100:00100000:3.0:1782229171.093450:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 45 00000100:00100000:3.0:1782229171.093462:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+30:14526:x1868802309613824:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:3.0:1782229171.093484:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229171.093506:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c43 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.093567:0:14194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.093579:0:14194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c43 expref: 31 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.093619:0:14194:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.093634:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c43 expref: 31 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.093647:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:3.0:1782229171.093650:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782229171.093654:0:14194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c43 expref: 31 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229171.093663:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051e00, rc 0) 00000100:00100000:3.0:1782229171.093734:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+31:14526:x1868802309613824:12345-192.168.204.22@tcp:101:bash.0 Request processed in 275us (9327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229171.093741:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 45 00010000:00010000:3.0:1782229171.707897:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229171.835659:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782229171.835686:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd42a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329518080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782229171.835831:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782229171.836144:0:14831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329518080 00000100:00100000:2.0:1782229171.836177:0:14831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329518080 00000100:00100000:2.0:1782229171.836256:0:14831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782229171.836266:0:14831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329518080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782229171.836303:0:14831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229171.836352:0:14831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1868802329518080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229171.836359:0:14831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782229171.836421:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd42a36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1868802329518080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782229171.836744:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1782229172.091742:0:14225:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782229172.091751:0:14225:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782229172.091784:0:14225:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782229172.091792:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1782229172.091936:0:14225:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14225:1868802329518208:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782229172.092057:0:14225:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe58fe5300 going to sleep for 11 seconds 00000100:00100000:3.0:1782229172.100000:0:14225:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe77c0b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14225:1868802329518208:192.168.204.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782229172.100297:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.100382:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309613952 00000100:00100000:0.0:1782229172.100392:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309613952 00000100:00100000:0.0:1782229172.100568:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:0.0:1782229172.100582:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1f693db6-2191-4110-8410-5abdf5d0b559+31:14527:x1868802309613952:12345-192.168.204.22@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1782229172.100747:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1f693db6-2191-4110-8410-5abdf5d0b559+31:14527:x1868802309613952:12345-192.168.204.22@tcp:900:lhsmtool_posix.0 Request processed in 169us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229172.100756:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:2.0:1782229172.104635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229172.104737:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309614080 00000100:00100000:1.0:1782229172.104756:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309614080 00000100:00100000:1.0:1782229172.104909:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:1.0:1782229172.104932:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+31:14527:x1868802309614080:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782229172.104970:0:14195:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782229172.105113:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+31:14527:x1868802309614080:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 194us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229172.105129:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 46 00000100:00100000:3.0:1782229172.112292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.112787:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309614208 00000100:00100000:0.0:1782229172.112798:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309614208 00000100:00100000:0.0:1782229172.112868:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:0.0:1782229172.112879:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+31:14527:x1868802309614208:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782229172.112959:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.112996:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113009:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113027:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113034:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113052:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113083:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113091:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113096:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782229172.113145:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782229172.113150:0:14194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782229172.113164:0:14194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113176:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113191:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113198:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113204:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22400 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229172.113208:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113215:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113228:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe43930700) 00010000:00010000:0.0:1782229172.113231:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229172.113236:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113242:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22400/0x8e1c8a3488e64dac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113258:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113264:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113270:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113276:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229172.113296:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113303:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113311:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98fe42cb9800) 00010000:00010000:0.0:1782229172.113314:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229172.113317:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113322:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64db3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113336:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113342:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113347:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113352:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229172.113355:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113360:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113367:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:0.0:1782229172.113369:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782229172.113378:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.113384:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22800/0x8e1c8a3488e64dba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229172.113535:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+31:14527:x1868802309614208:12345-192.168.204.22@tcp:34:lhsmtool_posix.0 Request processed in 648us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229172.113543:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 47 00000100:00100000:0.0:1782229172.121139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.121395:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309614464 00000100:00100000:2.0:1782229172.121406:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309614464 00000100:00100000:2.0:1782229172.121518:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:2.0:1782229172.121540:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+31:14527:x1868802309614464:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229172.121561:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229172.121584:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64dc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c4a expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.121685:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.121701:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.121725:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229172.121737:0:14193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782229172.122072:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122081:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122103:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122109:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.122113:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122276:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122360:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:2.0:1782229172.122363:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782229172.122368:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122375:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64dc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122427:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64dc1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c4a expref: 33 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122460:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98fe43930700) 00010000:00010000:2.0:1782229172.122462:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229172.122467:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64dc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c4a expref: 33 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.122477:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917000, rc 0) 00000100:00100000:2.0:1782229172.122559:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+32:14527:x1868802309614464:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 1031us (1439us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1782229172.122576:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 48 00000100:00100000:1.0:1782229172.132545:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.132636:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309614592 00000100:00100000:0.0:1782229172.132646:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309614592 00000100:00100000:0.0:1782229172.132702:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:0.0:1782229172.132725:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+32:14527:x1868802309614592:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782229172.132763:0:14194:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782229172.132890:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+32:14527:x1868802309614592:12345-192.168.204.22@tcp:53:lhsmtool_posix.0 Request processed in 168us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229172.132898:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 49 00000100:00100000:3.0:1782229172.140910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229172.141768:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309614848 00000100:00100000:1.0:1782229172.141779:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309614848 00000100:00100000:1.0:1782229172.141849:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:1.0:1782229172.141859:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+32:14527:x1868802309614848:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229172.141878:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229172.141896:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014600/0x8e1c8a3488e64dd6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c51 expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782229172.142977:0:14195:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1782229172.142985:0:14195:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1782229172.143382:0:14195:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1782229172.145958:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015000/0x8e1c8a3488e64ddd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.145979:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015000/0x8e1c8a3488e64ddd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.145990:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015000/0x8e1c8a3488e64ddd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.146225:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014600/0x8e1c8a3488e64dd6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c51 expref: 35 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.146262:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015000/0x8e1c8a3488e64ddd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c51 expref: 34 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.146274:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7c00) 00010000:00010000:1.0:1782229172.146344:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782229172.146350:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe7d015000, rc 0) 00000100:00100000:1.0:1782229172.146556:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+34:14527:x1868802309614848:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 4697us (5656us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1782229172.146567:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 50 00000100:00100000:1.0:1782229172.154939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.155407:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309615104 00000100:00100000:0.0:1782229172.155417:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309615104 00000100:00100000:2.0:1782229172.155676:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:2.0:1782229172.155689:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+34:14527:x1868802309615104:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782229172.155760:0:15355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229172.155786:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015000/0x8e1c8a3488e64ddd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c51 expref: 34 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.155807:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7c00) 00010000:00010000:2.0:1782229172.155826:0:15355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782229172.155848:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.155863:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.155872:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.155884:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.155892:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.155898:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.155978:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156003:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156009:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156015:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.156019:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156027:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156036:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:2.0:1782229172.156039:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229172.156042:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156048:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64deb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156057:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156063:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156069:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156074:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.156094:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156102:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156110:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xaf9d7fbe (ffff98fe43930500) 00010000:00010000:2.0:1782229172.156113:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229172.156368:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.156376:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64df2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaf9d7fbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.157662:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+33:14527:x1868802309615104:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 1767us (2535us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782229172.157674:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 51 00000100:00100000:2.0:1782229172.163256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229172.164349:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309615232 00000100:00100000:1.0:1782229172.164362:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309615232 00000100:00100000:1.0:1782229172.164571:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:1.0:1782229172.164584:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd42a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+33:14527:x1868802309615232:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782229172.164606:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782229172.164632:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014600/0x8e1c8a3488e64df9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c58 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.164672:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014400/0x8e1c8a3488e64e00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.164686:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014400/0x8e1c8a3488e64e00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.164698:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014400/0x8e1c8a3488e64e00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.164843:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014600/0x8e1c8a3488e64df9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c58 expref: 35 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.164864:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d014400/0x8e1c8a3488e64e00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c58 expref: 34 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.164874:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:1.0:1782229172.164876:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782229172.164880:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe7d014400, rc 0) 00000100:00100000:1.0:1782229172.164980:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd42a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+34:14527:x1868802309615232:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 399us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229172.164988:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 52 00000100:00100000:3.0:1782229172.169860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.170133:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309615488 00000100:00100000:0.0:1782229172.170145:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309615488 00000100:00100000:0.0:1782229172.170213:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:0.0:1782229172.170225:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+34:14527:x1868802309615488:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782229172.170325:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.170343:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.170374:0:14194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782229172.171236:0:14194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1782229172.171250:0:14194:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 485167819336ns, next at 486167816998ns, rc = 0 00000004:00010000:0.0:1782229172.171787:0:14194:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e58597f7 reply state 00000000e236b3f5 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229172.171800:0:14194:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782229172.172290:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe77c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+36:14527:x1868802309615488:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 2056us (2429us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1782229172.172300:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 53 00000100:00100000:0.0:1782229172.178781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.178929:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309615616 00000100:00100000:2.0:1782229172.178940:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309615616 00000100:00100000:2.0:1782229172.179426:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 54 00000100:00100000:2.0:1782229172.179468:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+36:14527:x1868802309615616:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229172.179494:0:14195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229172.179513:0:14195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c5f expref: -99 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.179583:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 37 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.179619:0:14195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 37 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.179640:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:2.0:1782229172.179643:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782229172.179646:0:14195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916a00, rc 0) 00000100:00100000:2.0:1782229172.179713:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+37:14527:x1868802309615616:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 248us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.179719:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 54 00010000:00010000:3.0:1782229172.184570:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.184588:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.184596:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.184603:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e22e00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229172.184608:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.184616:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.184633:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:3.0:1782229172.184637:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782229172.184641:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.184647:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e22e00/0x8e1c8a3488e64e07 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229172.184789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229172.184940:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309615744 00000100:00100000:3.0:1782229172.184950:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309615744 00000100:00100000:3.0:1782229172.185080:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:3.0:1782229172.185090:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+5:2372:x1868802309615744:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782229172.185519:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+6:2372:x1868802309615744:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 429us (733us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1782229172.185549:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:3.0:1782229172.189222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.189312:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309616000 00000100:00100000:2.0:1782229172.189321:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309616000 00000100:00100000:2.0:1782229172.189377:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00100000:2.0:1782229172.189387:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+36:14527:x1868802309616000:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782229172.189652:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+37:14527:x1868802309616000:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 265us (439us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1782229172.189660:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 11 00000100:00080000:0.0:1782229172.192512:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229172.193403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.193690:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309616256 00000100:00100000:2.0:1782229172.193700:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309616256 00000100:00100000:2.0:1782229172.193845:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:2.0:1782229172.193855:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+37:14527:x1868802309616256:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782229172.193987:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+37:14527:x1868802309616256:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 132us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.193995:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 55 00000100:00100000:1.0:1782229172.198868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.199473:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309616384 00000100:00100000:2.0:1782229172.199495:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309616384 00000100:00100000:2.0:1782229172.199555:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:2.0:1782229172.199566:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+37:14527:x1868802309616384:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229172.199585:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229172.199617:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e15 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c66 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.199845:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.199860:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.199872:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229172.199907:0:14193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782229172.199935:0:14193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.199962:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e15 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c66 expref: 39 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.199981:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c66 expref: 38 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.199990:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:2.0:1782229172.199992:0:14193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782229172.199996:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917c00, rc 0) 00000100:00100000:2.0:1782229172.200061:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+38:14527:x1868802309616384:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 496us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.200075:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 56 00000100:00100000:3.0:1782229172.204682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.204740:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309616512 00000100:00100000:2.0:1782229172.204750:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309616512 00000100:00100000:2.0:1782229172.204823:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:2.0:1782229172.204834:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+6:2372:x1868802309616512:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782229172.204852:0:15509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229172.204874:0:15509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c6d expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229172.204903:0:15509:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3aa8b4, blocks: 0x1 00010000:00010000:2.0:1782229172.204930:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1782229172.204936:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229172.204946:0:15509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 7 pid: 15509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.204966:0:15509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 7 pid: 15509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.204982:0:15509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50917000, rc 0) 00000100:00100000:2.0:1782229172.205045:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+7:2372:x1868802309616512:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 213us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.205053:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:3.0:1782229172.210821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.210911:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309616768 00000100:00100000:0.0:1782229172.210930:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309616768 00000100:00100000:0.0:1782229172.210994:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:0.0:1782229172.211004:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+38:14527:x1868802309616768:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782229172.211139:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+38:14527:x1868802309616768:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 137us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229172.211148:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 57 00000100:00100000:1.0:1782229172.215658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.215949:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309616896 00000100:00100000:2.0:1782229172.215959:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309616896 00000100:00100000:2.0:1782229172.216030:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 58 00000100:00100000:2.0:1782229172.216040:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+38:14527:x1868802309616896:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1782229172.289632:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.289673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.289699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.289719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229172.289772:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309617536 00000100:00100000:0.0:1782229172.289772:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229172.289782:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309617536 00000100:00100000:0.0:1782229172.289792:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309617280 00000100:00100000:0.0:1782229172.289804:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309617280 00000100:00100000:3.0:1782229172.289831:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309617152 00000100:00100000:3.0:1782229172.289834:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309617152 00000100:00100000:0.0:1782229172.289835:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:0.0:1782229172.289844:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+11:2373:x1868802309617280:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229172.289846:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309617408 00000100:00100000:3.0:1782229172.289848:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309617408 00000100:00100000:3.0:1782229172.289861:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:3.0:1782229172.289867:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309617536:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:3.0:1782229172.289940:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309617536:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 73us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229172.289948:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:1.0:1782229172.289953:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309617024 00000100:00100000:1.0:1782229172.289956:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309617024 00000100:00100000:3.0:1782229172.289963:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:3.0:1782229172.289969:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+5:2373:x1868802309617152:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:1.0:1782229172.289983:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 121 00000100:00100000:1.0:1782229172.289989:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59ea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2373:x1868802309617024:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229172.290321:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+11:2373:x1868802309617280:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 476us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229172.290329:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 27 00000100:00100000:0.0:1782229172.290711:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:0.0:1782229172.290720:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309617408:12345-192.168.204.22@tcp:400:kworker.0 00000100:00100000:0.0:1782229172.290763:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:afbb5fd9-ada8-4dd7-ad71-331ce2f77024+5:2373:x1868802309617408:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 45us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229172.290770:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00080000:2.0:1782229172.291030:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782229172.291036:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782229172.291038:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782229172.291090:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+5:2373:x1868802309617152:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 1119us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229172.291098:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:1.0:1782229172.291262:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59ea9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b66bf3ee-7d1f-404e-bf76-c7ae7eb660f7+13:2373:x1868802309617024:12345-192.168.204.22@tcp:400:kworker.0 Request processed in 1271us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229172.291270:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 121 00000001:00080000:3.0:1782229172.317641:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:3.0:1782229172.317657:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1782229172.317755:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000100:00100000:3.0:1782229172.317892:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782229172.317925:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329518336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782229172.318022:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1782229172.318134:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:3.0:1782229172.318163:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1782229172.318210:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1782229172.318269:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329518336 00000100:00100000:1.0:1782229172.318278:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329518336 00000100:00100000:1.0:1782229172.318338:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782229172.318348:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329518336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782229172.318781:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+13:14527:x1868802309616896:12345-192.168.204.22@tcp:44:lhsmtool_posix.0 Request processed in 102737us (103128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.318792:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 58 00002000:00010000:1.0:1782229172.318922:0:14829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782229172.318926:0:14829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1782229172.318928:0:14829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782229172.318930:0:14829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782229172 -> 1782229172 00002000:00010000:1.0:1782229172.318932:0:14829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782229172.319043:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1868802329518336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 696us (1020us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1782229172.319050:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1782229172.319545:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98fe5827ce00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1782229172.319553:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329518336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782229172.329581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.329725:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309617664 00000100:00100000:2.0:1782229172.329744:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309617664 00000100:00100000:1.0:1782229172.329864:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:1.0:1782229172.329875:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+7:2372:x1868802309617664:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782229172.330013:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+7:2372:x1868802309617664:12345-192.168.204.22@tcp:16:lhsmtool_posix.0 Request processed in 139us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229172.330022:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:0.0:1782229172.332544:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229172.332591:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309617920 00000100:00100000:1.0:1782229172.332608:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309617920 00000100:00100000:1.0:1782229172.332658:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 59 00000100:00100000:1.0:1782229172.332668:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+13:14527:x1868802309617920:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782229172.332798:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229172.332821:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c66 expref: 13 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.332837:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:1.0:1782229172.332840:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782229172.332863:0:14193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.332889:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.332896:0:14193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782229172.333088:0:14193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065357f58 reply state 000000001dc35c6f transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229172.333097:0:14193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782229172.333364:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1f693db6-2191-4110-8410-5abdf5d0b559+14:14527:x1868802309617920:12345-192.168.204.22@tcp:36:lhsmtool_posix.0 Request processed in 698us (828us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1782229172.333370:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 59 00010000:00010000:3.0:1782229172.335013:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.335026:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.335033:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.335039:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d015c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:3.0:1782229172.335043:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.335050:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.335065:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:3.0:1782229172.335068:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782229172.335072:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.335078:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe7d015c00/0x8e1c8a3488e64e2a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.337281:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229172.337574:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309618048 00000100:00100000:3.0:1782229172.337594:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309618048 00000100:00100000:3.0:1782229172.337966:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:3.0:1782229172.337991:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd425ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1f693db6-2191-4110-8410-5abdf5d0b559+7:14527:x1868802309618048:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782229172.338007:0:14827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782229172.338026:0:14827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c74 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.338059:0:14827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 8 pid: 15509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.338068:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229172.338072:0:14827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782229172.338077:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 8 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.338775:0:14827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 8 pid: 15509 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.338806:0:14827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 8 pid: 15509 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782229172.338823:0:14827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe5827e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14827:1868802329518464:192.168.204.22@tcp:104: 00000100:00100000:3.0:1782229172.338933:0:14827:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe6f201480 going to sleep for 11 seconds 00000100:00100000:0.0:1782229172.347246:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229172.347309:0:14827:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe5827e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14827:1868802329518464:192.168.204.22@tcp:104: 00010000:00010000:3.0:1782229172.347343:0:14827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 8 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782229172.347379:0:14827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe82051200, rc 0) 00000100:00100000:3.0:1782229172.347494:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd425ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1f693db6-2191-4110-8410-5abdf5d0b559+8:14527:x1868802309618048:12345-192.168.204.22@tcp:101:lhsmtool_posix.0 Request processed in 9518us (10220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229172.347504:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:1.0:1782229172.347565:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309618176 00000100:00100000:1.0:1782229172.347573:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309618176 00010000:00010000:1.0:1782229172.347608:0:14180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 8 pid: 15509 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229172.347651:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:1.0:1782229172.347660:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+8:2373:x1868802309618176:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782229172.347676:0:14180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782229172.347697:0:14180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 8 pid: 15509 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.347712:0:14180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 8 pid: 15509 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.347748:0:14180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ee569bb/0x8e1c8a3488e64e23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c6d expref: 8 pid: 15509 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.347764:0:14180:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229172.347781:0:14180:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229172.347788:0:14180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 7 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.347800:0:14180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 7 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.347833:0:14180:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 7 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229172.347848:0:14180:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14180:1868802329518592:192.168.204.22@tcp:105: 00000100:00100000:1.0:1782229172.347910:0:14180:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782229172.355872:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229172.356100:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309618304 00000100:00100000:3.0:1782229172.356109:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309618304 00000100:00100000:3.0:1782229172.356171:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:3.0:1782229172.356181:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+8:2373:x1868802309618304:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782229172.356373:0:14830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782229172.356377:0:14830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782229171 00002000:00010000:3.0:1782229172.356380:0:14830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782229169 00002000:00010000:3.0:1782229172.356382:0:14830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1782229172 -> 1782229171 00002000:00010000:3.0:1782229172.356385:0:14830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782229172.356486:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+9:2373:x1868802309618304:12345-192.168.204.22@tcp:2:lhsmtool_posix.0 Request processed in 306us (625us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1782229172.356495:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 17 00000100:00100000:1.0:1782229172.356875:0:14180:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14180:1868802329518592:192.168.204.22@tcp:105: 00010000:00010000:1.0:1782229172.356895:0:14180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782229172.356941:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f693db6-2191-4110-8410-5abdf5d0b559+8:2373:x1868802309618176:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 9282us (9705us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229172.356949:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:0.0:1782229172.359508:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229172.360401:0:14829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309618432 00000100:00100000:1.0:1782229172.360411:0:14829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309618432 00000100:00100000:1.0:1782229172.360508:0:14829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:1.0:1782229172.360533:0:14829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fd43424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1f693db6-2191-4110-8410-5abdf5d0b559+8:2372:x1868802309618432:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782229172.360578:0:14829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.360597:0:14829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 8 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.360605:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782229172.360610:0:14829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782229172.360614:0:14829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.360650:0:14829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 8 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.360666:0:14829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 8 pid: 14827 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229172.360681:0:14829:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14829:1868802329518720:192.168.204.22@tcp:104: 00000100:00100000:1.0:1782229172.360757:0:14829:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe5096bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782229172.363747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229172.364400:0:14829:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe74e78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14829:1868802329518720:192.168.204.22@tcp:104: 00010000:00010000:1.0:1782229172.364467:0:14829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.366613:0:16214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309618560 00000100:00100000:2.0:1782229172.366625:0:16214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309618560 00010000:00010000:2.0:1782229172.366671:0:16214:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 9 pid: 14827 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.366711:0:16214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:2.0:1782229172.366722:0:16214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe7bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f693db6-2191-4110-8410-5abdf5d0b559+9:2373:x1868802309618560:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229172.366739:0:16214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229172.366761:0:16214:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 9 pid: 14827 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.366777:0:16214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 9 pid: 14827 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.366799:0:16214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc35bb7e/0x8e1c8a3488e64e31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c74 expref: 9 pid: 14827 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.366838:0:16214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782229172.366842:0:16214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782229172.366848:0:16214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.366859:0:16214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.366958:0:16214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782229172.367019:0:16214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe7bf11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f693db6-2191-4110-8410-5abdf5d0b559+8:2373:x1868802309618560:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 299us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.367028:0:16214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00010000:00010000:1.0:1782229172.367964:0:14829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.367989:0:14829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.368018:0:14829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.368027:0:14829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.368034:0:14829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.368041:0:14829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe7d014600 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:1.0:1782229172.368044:0:14829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.368165:0:14829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.368181:0:14829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782229172.368189:0:14829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000140cb493/0x8e1c8a3488e64e38 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782229172.368338:0:14829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fd43424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1f693db6-2191-4110-8410-5abdf5d0b559+7:2372:x1868802309618432:12345-192.168.204.22@tcp:1:lhsmtool_posix.0 Request processed in 7805us (8833us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229172.368348:0:14829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 18 00000100:00100000:0.0:1782229172.369936:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.370006:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309618816 00000100:00100000:2.0:1782229172.370014:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309618816 00000100:00100000:2.0:1782229172.370071:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 60 00000100:00100000:2.0:1782229172.370080:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+13:14527:x1868802309618816:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782229172.370163:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.370178:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.370188:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.370395:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.370409:0:15355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 14 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.370415:0:15355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.370470:0:15355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 14 pid: 14195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.370484:0:15355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 14 pid: 14195 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.370498:0:15355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15355:1868802329518848:192.168.204.22@tcp:104: 00000100:00100000:2.0:1782229172.370562:0:15355:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe662e7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782229172.373082:0:15355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15355:1868802329518848:192.168.204.22@tcp:104: 00010000:00010000:2.0:1782229172.373110:0:15355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229172.374176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.374255:0:14179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309618944 00000100:00100000:2.0:1782229172.374262:0:14179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309618944 00010000:00010000:2.0:1782229172.374296:0:14179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 15 pid: 14195 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.374373:0:14179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:2.0:1782229172.374382:0:14179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f693db6-2191-4110-8410-5abdf5d0b559+15:2372:x1868802309618944:12345-192.168.204.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782229172.374396:0:14179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782229172.374414:0:14179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 15 pid: 14195 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.374453:0:14179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 15 pid: 14195 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.374475:0:14179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c5f expref: 15 pid: 14195 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.374491:0:14179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:2.0:1782229172.374496:0:14179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.374505:0:14179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.374512:0:14179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.374533:0:14179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782229172.374654:0:15355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.374662:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782229172.374838:0:15355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1782229172.375004:0:15355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1782229172.375060:0:15355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1782229172.375141:0:15355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15355:1868802329518976:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782229172.375197:0:15355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229172.375229:0:15355:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe742e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782229172.375276:0:14179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f693db6-2191-4110-8410-5abdf5d0b559+17:2372:x1868802309618944:12345-192.168.204.22@tcp:103:ldlm_bl.0 Request processed in 894us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.375285:0:14179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 16 00000100:00100000:3.0:1782229172.376219:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329518976 00000100:00100000:3.0:1782229172.376227:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329518976 00000100:00100000:3.0:1782229172.376298:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782229172.376307:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15355:x1868802329518976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782229172.376404:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15355:x1868802329518976:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782229172.376411:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782229172.376748:0:15355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15355:1868802329518976:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1782229172.377469:0:15355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1782229172.377545:0:15355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15355:1868802329519104:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782229172.377594:0:15355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229172.378892:0:15355:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe50b8b480 going to sleep for 11 seconds 00000100:00100000:1.0:1782229172.380949:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329519104 00000100:00100000:1.0:1782229172.380963:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329519104 00000100:00100000:1.0:1782229172.381026:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782229172.381036:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:15355:x1868802329519104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782229172.381982:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:15355:x1868802329519104:12345-0@lo:1000:mdt00_003.0 Request processed in 944us (4385us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1782229172.381992:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782229172.382921:0:15355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15355:1868802329519104:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1782229172.382968:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.382980:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.382988:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.382995:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229172.383000:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383009:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383028:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:0.0:1782229172.383031:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229172.383036:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383060:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916800/0x8e1c8a3488e64e46 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383095:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383101:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383107:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383112:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe59e23800 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:0.0:1782229172.383115:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383121:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383129:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:0.0:1782229172.383131:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782229172.383138:0:15355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c43 expref: 17 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383150:0:15355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c43 expref: 17 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383158:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c43 expref: 17 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.383211:0:15355:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98fe82051e00/0x8e1c8a3488e64da5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c43 expref: 17 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782229172.383227:0:15355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15355:1868802329519232:192.168.204.22@tcp:105: 00000100:00100000:0.0:1782229172.383297:0:15355:0:(client.c:2701:ptlrpc_set_wait()) set ffff98fe68ed9300 going to sleep for 11 seconds 00000100:00100000:0.0:1782229172.390079:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:1.0:1782229172.390244:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309619072 00000100:00100000:1.0:1782229172.390255:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309619072 00000100:00100000:1.0:1782229172.390407:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:1.0:1782229172.390419:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+18:14526:x1868802309619072:12345-192.168.204.22@tcp:49:bash.0 00000100:00100000:1.0:1782229172.390601:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+18:14526:x1868802309619072:12345-192.168.204.22@tcp:49:bash.0 Request processed in 183us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782229172.390609:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 12 00000100:00100000:2.0:1782229172.390743:0:15355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15355:1868802329519232:192.168.204.22@tcp:105: 00010000:00010000:2.0:1782229172.390880:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.390892:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe59e23800/0x8e1c8a3488e64d9e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.390949:0:15355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.390965:0:15355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.390977:0:15355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.390989:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.390996:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391002:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391009:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.391014:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391021:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391033:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:2.0:1782229172.391036:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229172.391040:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391045:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e4d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391528:0:15355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391536:0:15355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391542:0:15355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391548:0:15355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.391552:0:15355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391558:0:15355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391566:0:15355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:2.0:1782229172.391569:0:15355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782229172.391572:0:15355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.391578:0:15355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.392118:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1f693db6-2191-4110-8410-5abdf5d0b559+17:14527:x1868802309618816:12345-192.168.204.22@tcp:57:lhsmtool_posix.0 Request processed in 21980us (22128us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1782229172.392135:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 60 00000020:00080000:2.0:1782229172.392140:0:15355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782229172.400835:0:14225:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782229172.400845:0:14225:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782229172.400889:0:14225:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1782229172.400896:0:14225:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1782229172.401388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.401681:0:14830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309619200 00000100:00100000:2.0:1782229172.401690:0:14830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309619200 00000100:00100000:2.0:1782229172.401751:0:14830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:2.0:1782229172.401761:0:14830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe5827e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+7:14526:x1868802309619200:12345-192.168.204.22@tcp:101:bash.0 00010000:00010000:2.0:1782229172.401791:0:14830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229172.401812:0:14830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000739608b4/0x8e1c8a3488e64e54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c7b expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782229172.401837:0:14830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a3aa8b3, atime: 0x6a3aa8b1, ctime: 0x6a3aa8b3, blocks: 0x1 00010000:00010000:2.0:1782229172.401858:0:14830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1782229172.401864:0:14830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782229172.401875:0:14830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000739608b4/0x8e1c8a3488e64e54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c7b expref: 8 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.401892:0:14830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000739608b4/0x8e1c8a3488e64e54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c7b expref: 8 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.401905:0:14830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916800, rc 0) 00000100:00100000:2.0:1782229172.401962:0:14830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe5827e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1f693db6-2191-4110-8410-5abdf5d0b559+8:14526:x1868802309619200:12345-192.168.204.22@tcp:101:bash.0 Request processed in 202us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.401970:0:14830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 19 00000100:00100000:0.0:1782229172.410826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229172.410869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:3.0:1782229172.410954:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309619456 00000100:00100000:3.0:1782229172.410965:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309619456 00000100:00100000:1.0:1782229172.412073:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309619712 00000100:00100000:1.0:1782229172.412081:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309619712 00000100:00100000:2.0:1782229172.412362:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 13 00000100:00100000:2.0:1782229172.412373:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+18:14527:x1868802309619456:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782229172.413030:0:14196:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782229172.413207:0:14196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1782229172.413592:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.413621:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.413633:0:14196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.413643:0:14196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.413650:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.413656:0:14196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.413722:0:14196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782229172.413825:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+20:14527:x1868802309619456:12345-192.168.204.22@tcp:35:lhsmtool_posix.0 Request processed in 1450us (3004us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1782229172.413835:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 13 00000020:00080000:2.0:1782229172.413840:0:14196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782229172.413860:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 14 00000100:00100000:2.0:1782229172.413868:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+19:14526:x1868802309619712:12345-192.168.204.22@tcp:35:bash.0 00000001:00080000:2.0:1782229172.414030:0:14196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1782229172.414129:0:14196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1782229172.414192:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+22:14526:x1868802309619712:12345-192.168.204.22@tcp:35:bash.0 Request processed in 324us (3323us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1782229172.414200:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 14 00000020:00080000:2.0:1782229172.414203:0:14196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1782229172.417680:0:14182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782229172.417694:0:14182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.417742:0:14182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc1737ce0) 00010000:00010000:0.0:1782229172.417747:0:14182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.417757:0:14182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.417774:0:14182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98fe43bc7b00) 00010000:00010000:0.0:1782229172.417778:0:14182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782229172.417781:0:14182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782229172.417808:0:14182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.417897:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229172.417900:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782229172.417903:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782229172.546306:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.546563:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309619968 00000100:00100000:2.0:1782229172.546574:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309619968 00000100:00100000:2.0:1782229172.546641:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:2.0:1782229172.546652:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+22:14537:x1868802309619968:12345-192.168.204.22@tcp:101:lfs.0 00010000:00010000:2.0:1782229172.546677:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782229172.546698:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcb949b6f9949c82 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782229172.546980:0:14194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782229172.547158:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c82 expref: 24 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.547172:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fe42cb9600) 00010000:00010000:2.0:1782229172.547175:0:14194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782229172.547181:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.22@tcp remote: 0xfcb949b6f9949c82 expref: 24 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.547193:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fe50916a00, rc 0) 00000100:00100000:2.0:1782229172.547253:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1f693db6-2191-4110-8410-5abdf5d0b559+23:14537:x1868802309619968:12345-192.168.204.22@tcp:101:lfs.0 Request processed in 603us (957us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1782229172.547260:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 61 00000100:00100000:1.0:1782229172.551266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.552129:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309620096 00000100:00100000:2.0:1782229172.552140:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309620096 00000100:00100000:2.0:1782229172.552205:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:2.0:1782229172.552215:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+23:14537:x1868802309620096:12345-192.168.204.22@tcp:34:lfs.0 00010000:00010000:2.0:1782229172.552312:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552331:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552343:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552357:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552365:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552371:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552678:0:14195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552688:0:14195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552695:0:14195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782229172.552736:0:14195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552748:0:14195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552764:0:14195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552770:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.552777:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50916a00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.553018:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553029:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553041:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98fe43933a00) 00010000:00010000:2.0:1782229172.553044:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229172.553050:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553065:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50916a00/0x8e1c8a3488e64e70 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553078:0:14195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553084:0:14195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553090:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553094:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917c00 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.553103:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553110:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553117:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98fe43930300) 00010000:00010000:2.0:1782229172.553119:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229172.553121:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553126:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917c00/0x8e1c8a3488e64e77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553140:0:14195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553145:0:14195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553150:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553155:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fe50917000 already unused, calling callback (ffffffffc21734f0) 00010000:00010000:2.0:1782229172.553158:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553163:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553169:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98fe42cb9400) 00010000:00010000:2.0:1782229172.553171:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782229172.553178:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782229172.553184:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fe50917000/0x8e1c8a3488e64e7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782229172.553309:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1f693db6-2191-4110-8410-5abdf5d0b559+23:14537:x1868802309620096:12345-192.168.204.22@tcp:34:lfs.0 Request processed in 1093us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229172.553317:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 62 00000100:00100000:0.0:1782229172.562015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229172.562091:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309620352 00000100:00100000:2.0:1782229172.562102:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309620352 00000100:00100000:2.0:1782229172.562162:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 15 00000100:00100000:2.0:1782229172.562171:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+23:14537:x1868802309620352:12345-192.168.204.22@tcp:35:lfs.0 00000100:00100000:2.0:1782229172.562628:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1f693db6-2191-4110-8410-5abdf5d0b559+24:14537:x1868802309620352:12345-192.168.204.22@tcp:35:lfs.0 Request processed in 456us (623us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1782229172.562636:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 15 00010000:00010000:2.0:1782229172.731701:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782229173.759286:0:14181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782229174.269393:0:16364:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1782229174.780267:0:14182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782229174.908045:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fd425cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329519360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782229174.908122:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229174.908337:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329519616:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908369:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229174.908390:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782229174.908395:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3311:1868802329519488:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908451:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229174.908475:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329520000:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229174.908526:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329519616 00000100:00100000:0.0:1782229174.908533:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329519616 00000100:00100000:0.0:1782229174.908595:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782229174.908606:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1868802329519616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908665:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1868802329519616:12345-0@lo:400:kworker.0 Request processed in 61us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229174.908673:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782229174.908697:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329519488 00000100:00100000:0.0:1782229174.908700:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329519488 00000100:00100000:0.0:1782229174.908721:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782229174.908727:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3311:x1868802329519488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908751:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59eaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41+19:3311:x1868802329519488:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229174.908756:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1782229174.908794:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782229174.908815:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329519744:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908839:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229174.908856:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782229174.908860:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff98fe779f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329519872:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782229174.908913:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329520000 00000100:00100000:0.0:1782229174.908915:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329520000 00000100:00100000:0.0:1782229174.908939:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329519744 00000100:00100000:0.0:1782229174.908941:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329519744 00000100:00100000:0.0:1782229174.908951:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329519872 00000100:00100000:0.0:1782229174.908953:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329519872 00000100:00100000:0.0:1782229174.908966:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782229174.908971:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329520000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.908998:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1868802329520000:12345-0@lo:400:kworker.0 Request processed in 27us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229174.909003:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782229174.909015:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782229174.909020:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe779f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329519744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.909046:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe779f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868802329519744:12345-0@lo:400:kworker.0 Request processed in 26us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229174.909051:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782229174.909062:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782229174.909068:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329519872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.909089:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868802329519872:12345-0@lo:400:kworker.0 Request processed in 22us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782229174.909094:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1782229174.909123:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782229174.909150:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1868802329519872:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.909160:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868802329519744:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.909184:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:09a36ffd-1c8e-4eae-8f1c-059ef97c8e41:3311:1868802329519488:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.909192:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1868802329520000:0@lo:400:kworker.0 00000100:00100000:0.0:1782229174.909200:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fe779f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1868802329519616:0@lo:400:kworker.0 00000100:00100000:2.0:1782229174.909637:0:14832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802329519360 00000100:00100000:2.0:1782229174.909643:0:14832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802329519360 00000100:00100000:2.0:1782229174.911376:0:14832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782229174.911390:0:14832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe74e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329519360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782229174.911449:0:14832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782229174.911533:0:14832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe74e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1868802329519360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229174.911541:0:14832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782229174.911592:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff98fd425cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1868802329519360:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782229174.915982:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782229175.370234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:0.0:1782229175.370281:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.22@tcp (source: 12345-192.168.204.22@tcp) 00000100:00100000:2.0:1782229175.370488:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309620608 00000100:00100000:2.0:1782229175.370507:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309620608 00000100:00100000:2.0:1782229175.370600:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00100000:2.0:1782229175.370612:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+8:2370:x1868802309620608:12345-192.168.204.22@tcp:16:kworker.0 00000100:00100000:2.0:1782229175.370745:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1f693db6-2191-4110-8410-5abdf5d0b559+8:2370:x1868802309620608:12345-192.168.204.22@tcp:16:kworker.0 Request processed in 136us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782229175.370755:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 20 00000100:00080000:0.0:1782229175.371025:0:14189:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782229175.372412:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868802309620480 00000100:00100000:3.0:1782229175.372457:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868802309620480 00002000:00100000:3.0:1782229175.372517:0:14833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff98fe59e54700 x1868802309620480/t0(0) o4->1f693db6-2191-4110-8410-5abdf5d0b559@192.168.204.22@tcp:346/0 lens 504/0 e 0 to 0 dl 1782229186 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1782229175.372531:0:14833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe59e54700 with x1868802309620480 ext(0->8) 00002000:00010000:3.0:1782229175.372538:0:14833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98fe59e54700 00000100:00100000:3.0:1782229175.372592:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.22@tcp, seq: 0 00000100:00100000:3.0:1782229175.372604:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fe59e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1f693db6-2191-4110-8410-5abdf5d0b559+8:2371:x1868802309620480:12345-192.168.204.22@tcp:4:bash.0 00000100:00100000:3.0:1782229175.380426:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fe59e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1f693db6-2191-4110-8410-5abdf5d0b559+10:2371:x1868802309620480:12345-192.168.204.22@tcp:4:bash.0 Request processed in 7803us (10181us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1782229175.380469:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.22@tcp, seq: 0 00002000:00100000:3.0:1782229175.380489:0:14833:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff98fe59e54700 x1868802309620480/t8589934598(0) o4->1f693db6-2191-4110-8410-5abdf5d0b559@192.168.204.22@tcp:346/0 lens 504/448 e 0 to 0 dl 1782229186 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1782229175.380501:0:14833:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff98fe59e54700 with x1868802309620480 ext(0->8) 00002000:00010000:3.0:1782229175.380510:0:14833:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98fe59e54700 00010000:00010000:2.0:1782229175.803597:0:15357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29604 lines, 29604 kept, 0 dropped, 0 bad.